Settings

Theme

MLC LLM: Universal LLM Deployment with GPU Acceleration

github.com

3 points by crowwork 3 years ago · 1 comment

Reader

crowworkOP 3 years ago

Supported platforms include:

- Metal GPUs on iPhone and Intel/ARM MacBooks

- AMD and NVIDIA GPUs via Vulkan on Windows and Linux

- NVIDIA GPUs via CUDA on Windows and Linux

- WebGPU on browsers (through companion project WebLLM).

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection