Meta plans to not open the weights for its 400B model
twitter.comI don't think this tweet is an authoritative source
Agree, but I've seen other open-source ML people confirm it. For example:
Teknium: Okay and Ive had 4 high-ish level sources tell me they dont plan to release it ever though
I thought their whole point of opening the models in the first place was to undermine OpenAI, but this seems to invalidate that. Maybe their hand was forced?
I wonder if it has to do with Meta recently joining the “Frontier Model Forum” industry group alongside Microsoft and Google and OpenAI and Anthropic. AKA the group for regulatory capture by playing up “trust and safety”. They are the ones pushing for regulations which will potentially make it illegal to build models that are open or uncensored.
https://www.theguardian.com/technology/2023/jul/26/google-mi...
https://www.frontiermodelforum.org/updates/amazon-and-meta-j...
This whole group has a dystopian vibe to it, with forced assumptions for its members:
“Member firms must publicly acknowledge that frontier AI models pose both public safety and societal risks, and publicly disclose guidelines for evaluating and mitigating those risks.”
In other words, all the members must amplify the same safety tropes to force regulation on the rest of us.
How cleverly they sold the idea of LLM safety to everyone, as if it was an actually dangerous thing.
they never promised they would
Disappointed. I’d planned to download the model, and build a system powerful enough to run it locally.