Junru Shao (@junrushao) on X

X (formerly Twitter) ยท

1 min read Original article โ†—

@junrushao

(1/2) ๐Ÿฆ™ Buckle up and ready for a wild llama ride with 70B Llama-2 on a single MacBook ๐Ÿ’ป ๐Ÿคฏ Now 70B Llama-2 can be run smoothly on an 64G M2 max with 4bit quantization. ๐Ÿ‘‰ Here is a step-by-step guide: mlc.ai/mlc-llm/docs/gโ€ฆ ๐Ÿš€ How about the performance? It's

00:00

12:48 AM ยท Jul 20, 2023156KViews