GraySoft

Download guIDE →

ggml-org author hub

NVIDIA Nemotron 3.5 Lightning 30B A3B Run it in the Llama app: https://llama.app Or from the terminal: bash llama serve hf ggml org/NVIDIA Nemotron 3.5 Lightning 30B A3B GGUF Source models https://huggingface.co/nvidia/NVIDIA Nemotron 3.5 Lightning 30B A3B BF16 < https://hugging…

Models

55

Downloads

3,789,714

ggml-org/Qwen3.8-27B-GGUF

2,253,564 downloads · image-text-to-text

ggml-org/gemma-4-26B-A4B-it-GGUF

337,534 downloads · image-text-to-text

ggml-org/gpt-oss-20b-GGUF

210,786 downloads · text-generation

ggml-org/gpt-oss-120b-GGUF

187,433 downloads · text-generation

ggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF

185,182 downloads · text-generation

ggml-org/Qwen3.6-35B-A3B-GGUF

118,744 downloads · image-text-to-text

ggml-org/Qwen3.6-27B-GGUF

77,278 downloads · image-text-to-text

ggml-org/Clef-Flash-GGUF

63,629 downloads · image-text-to-text

ggml-org/Qwen3.5-0.8B-GGUF

62,911 downloads · image-text-to-text

ggml-org/Qwen3.8-Flash-Next-GGUF

42,556 downloads · image-text-to-text

ggml-org/Qwen3-0.6B-GGUF

41,409 downloads · text-generation

ggml-org/gemma-4-31B-it-GGUF

33,218 downloads · image-text-to-text

ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF

29,351 downloads · image-text-to-text

ggml-org/Clef-GGUF

25,770 downloads · image-text-to-text

ggml-org/MiMo-V2.6-Flash-RL-GGUF

19,943 downloads · image-text-to-text

ggml-org/vllm-d3-GGUF

16,136 downloads · image-text-to-text

ggml-org/OpenJev-GGUF

11,830 downloads · image-text-to-text

ggml-org/vllm-d3-flash-GGUF

8,539 downloads · image-text-to-text

ggml-org/MiMo-V2.6-Flash-MOPD-GGUF

7,069 downloads · image-text-to-text

ggml-org/GLM-5.3-Flash-GGUF

6,558 downloads · image-text-to-text

ggml-org/SmolVLM2-256M-Video-Instruct-GGUF

5,926 downloads · image-text-to-text

ggml-org/vllm-d3-mini-GGUF

5,798 downloads · image-text-to-text

ggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF

5,331 downloads · text-generation

ggml-org/DeepSeek-V4-Flash-0731-GGUF

4,104 downloads · text-generation

ggml-org/Nemotron-Nano-3-30B-A3B-GGUF

2,727 downloads · text-generation

ggml-org/Qwen3-8B-GGUF

2,624 downloads · text-generation

ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF

2,609 downloads · image-text-to-text

ggml-org/vllm-d3-lite-GGUF

2,355 downloads · image-text-to-text

ggml-org/Laguna-XS-2.1-GGUF

2,337 downloads · text-generation

ggml-org/SmolLM2-135M-GGUF

2,236 downloads · text-generation

ggml-org/MiMo-V2.6-Pro-MOPD-GGUF

2,116 downloads · image-text-to-text

ggml-org/vllm-d3-edge-GGUF

2,099 downloads · image-text-to-text

ggml-org/vllm-d3-nano-GGUF

2,037 downloads · image-text-to-text

ggml-org/Muse-Glimmer-30B-GGUF

1,731 downloads · image-text-to-text

ggml-org/DeepSeek-V4-Flash-GGUF

1,252 downloads · text-generation

ggml-org/GLM-4.5V-GGUF

791 downloads · image-text-to-text

ggml-org/Laguna-S-2.1-GGUF

771 downloads · text-generation

ggml-org/GLM-4.5-Air-GGUF

686 downloads · text-generation

ggml-org/gemma-4-26B-A4B-GGUF

589 downloads · image-text-to-text

ggml-org/gemma-4-31B-GGUF

532 downloads · image-text-to-text

ggml-org/Voxtral-Mini-4B-Realtime-2602-GGUF

433 downloads · automatic-speech-recognition

ggml-org/Qwen3.5-0.8B-Base-GGUF

394 downloads · image-text-to-text

ggml-org/Qwen3-0.6B-Base-GGUF

256 downloads · text-generation

ggml-org/GLM-4.5V-GGUF-old

201 downloads · image-text-to-text

ggml-org/Qwen3-8B-Base-GGUF

188 downloads · text-generation

ggml-org/LongCat-Flash-Chat-GGUF

151 downloads ·

ggml-org/Qwen3-TTS-12Hz-1.7B-Base-GGUF

0 downloads ·

ggml-org/dots3-note-prev-GGUF

0 downloads ·

ggml-org/Llama-2-7B-GGUF

0 downloads · text-generation

ggml-org/MiMo-V2.6-Distill-Qwen-9B-GGUF

0 downloads · image-text-to-text

ggml-org/tinyopenjev-for-testing-gguf

0 downloads ·

ggml-org/tinylaya-for-testing-gguf

0 downloads ·

ggml-org/MiMo-V2.6-Pro-RL-GGUF

0 downloads · image-text-to-text

ggml-org/Muse-Spark-Open-816B-A42B-GGUF

0 downloads · image-text-to-text

ggml-org/LFM2.5-24B-A2B-GGUF

0 downloads · text-generation

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models