The delicious irony of Anthropic bemoaning distillation
twitter.comBait title for bait point.
----------------- If weights aren't the same as the data even though they produce the data, how are weights that produce similar outputs different?
The "legal view" smuggles the cintested distinction for distillation by saying it's substantially the same product.
I'd also argue that since the outputs of a llm aren't to my knowledge (IANAL) copyrightable ... There is no need to worry about copyright... I could be wrong about this though.