Show HN: Compress Long LLM Prompt, Right in your web browser

5 points by letaem77 a year ago · 0 comments · 1 min read

I tried to port LLMLingua-2's official Python implementation into TypeScript.

For best performance, open the URL with a WebGPU enabled web browser.

Learn More: https://github.com/atjsh/llmlingua-2-js

No comments yet.