Archive Public Hugging Face Models and Datasets as Immutable, Verifiable Trees
github.com
2 threads
Potentially related: check out https://news.ycombinator.com/item?id=48867720, https://huggingbay.xyz/start was hosting these as torrents but appears to be down now (ssl proto error). Similar to https://academictorrents.com/
Publishing as a torrent solves for hash verification (assuming new torrents vs mutable torrents for underlying changes) and ease of sharing (imho).
Torrenting is a great solution as well. For now I just wanted direct download. Thanks for sharing those links!
If you have a NAS and want to back up open weight models with a little more structure than just "download and store" I created this toy project. It's actually working quite well for me already.