Ask HN: Why is so many packages in LLM dev brittle?
I've been a Software engineer for 5 years now, and recently started LLM dev.
A lot of the huggingface, accelerate and bitsandbytes are exceptionally brittle and newer models somehow get stuck in dependecy hell. you can probably blame pip