Nvidia-Nemotron-3.5-Bolt-74B-A9B-BF16
huggingface.co
1 thread
See also https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A..., which fits in a 24GB card through a special 2-bit quantisation.
See also https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A..., which fits in a 24GB card through a special 2-bit quantisation.