Ask HN: Suitable LLM models for an agent for user guides and docs?
Hi, i would like to implement an AI agent for my user guides and wiki (about 100 pages), so users can easily come in and interact with it. I expect the amount of content to increase quite a lot over time.
I would prefer it to the model to be self hosted, so I dont worry about how much APIs cost etc. My website content will be relatively small for a long time. Start playing with stuff like llama. You'll have to code it yourself. https://sych.io/blog/how-to-run-llama-2-locally-a-guide-to-r...