FP8 Deepseek R1 Distilled LLMs for SGLang and vLLM - a JamAndTeaStudios Collection

1 min read Original article ↗

updated

Accurate FP8 quantized deepseek R1 distilled models, ready for use with SGLang and vLLM!

Upvote

1