Ask HN: Are open-weight LLMs the new offline encyclopedias?
There was a time when offline encyclopedias were used heavily as internet was not widely available. I used to install britannica encyclopedia and Microsoft Encarta on my PCs (I had no internet at home at that time) and it had helped me a lot between the years 1999 to 2006.
Now we have open-weight LLMs. There are very good models of size < 15GB.
So I’m wondering:
- Are open-weight LLMs effectively becoming the next evolution of offline encyclopedias?
- If so, what replaces the idea of “citation” and “verifiability” in this paradigm, as they do hallucinate time to time ?
Curious how others here are thinking about this shift, especially folks building offline first educational systems. No, no they are not. The last thing I want from an encyclopaedia is information I can’t trust, inconsistent and contradictory depending on when and how I search. The point of an encyclopedia is that you can visit a very specific page under a very specific name and receive information that you know has been vetted and properly researched. You get precisely zero of any of this with an LLM, so they just seem like they’re fundamentally the wrong tool to even consider something like this for.