Show HN: ChainFactory – Run Structured LLM Inference with Easy Parallelism

2 points by garkotipankaj 2 years ago · 1 comment · 1 min read

Hi HN!

Disclaimer: I submitted another post about ChainFactory a few days ago.

Here's what has changed since:

- Added hash based caching of auto-generated prompts and masks.

- Did some internal restructuring and cleanup.

- Updated the order in which README doc introduces concepts and terminology.

Posting this again because honestly, I am kinda puzzled about what to add/fix/change due to having 0 users and no genuine feedback.

By genuine feedback, I mean feedback from strangers who do not have a social pressure to be polite and pull punches.

Please take a look if you find this interesting and leave a comment. If you think it's an deranged or stupid idea not worth your time, please at least leave a 'no' - I'd still be delighted as it's an honest opinion.

Thanks a lot!

PS: Is it okay to post updates and changes at regular intervals?