M3 Ultra Mac Studio Al Cluster Uses EXO 1.0 with RDMA over Thunderbolt 5 (80Gbps) for 2TB unified memory @ 3.2TB/s. Runs Kimi K2 Thinking (1T parameters) at 28 tok/sec with MLX tensor parallel. Up to 1.8x TPS w/ 2 Macs, 3.2x w/ 4 Macs. EXO 1.0 is now open-source (Apache 2.0).
00:00