GraySoft
Download guIDE →
Projects Models Compare Cloud benchmarks FAQ Download guIDE →

ggml-org author hub

NVIDIA Nemotron 3.5 Lightning 30B A3B Run with https://llama.app bash llama serve hf ggml org/NVIDIA Nemotron 3.5 Lightning 30B A3B GGUF Source models https://huggingface.co/nvidia/NVIDIA Nemotron 3.5 Lightning 30B A3B BF16 < https://huggingface.co/nvidia/NVIDIA Nemotron 3.5 Lig…

Models
33
Downloads
620,778
ggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF
251,614 downloads · text-generation
ggml-org/gemma-4-26B-A4B-it-GGUF
224,111 downloads · image-text-to-text
ggml-org/gpt-oss-20b-GGUF
48,439 downloads · text-generation
ggml-org/DeepSeek-V4-Flash-0731-GGUF
21,986 downloads · text-generation
ggml-org/Qwen3-0.6B-GGUF
20,152 downloads · text-generation
ggml-org/gpt-oss-120b-GGUF
17,442 downloads · text-generation
ggml-org/gemma-4-31B-it-GGUF
13,133 downloads · image-text-to-text
ggml-org/Qwen3.6-27B-GGUF
4,735 downloads · image-text-to-text
ggml-org/Qwen3.6-35B-A3B-GGUF
3,515 downloads · image-text-to-text
ggml-org/Nemotron-Nano-3-30B-A3B-GGUF
2,727 downloads · text-generation
ggml-org/DeepSeek-V4-Flash-GGUF
2,641 downloads · text-generation
ggml-org/SmolVLM2-256M-Video-Instruct-GGUF
2,444 downloads · image-text-to-text
ggml-org/Qwen3-8B-GGUF
2,043 downloads · text-generation
ggml-org/Laguna-XS-2.1-GGUF
1,654 downloads · text-generation
ggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF
1,381 downloads · text-generation
ggml-org/Qwen3.5-0.8B-GGUF
927 downloads · image-text-to-text
ggml-org/Laguna-S-2.1-GGUF
677 downloads · text-generation
ggml-org/Qwen3.5-0.8B-Base-GGUF
416 downloads · image-text-to-text
ggml-org/GLM-4.5V-GGUF
389 downloads · image-text-to-text
ggml-org/GLM-4.5V-GGUF-old
201 downloads · image-text-to-text
ggml-org/LongCat-Flash-Chat-GGUF
151 downloads ·
ggml-org/Qwen3-0.6B-Base-GGUF
0 downloads · text-generation
ggml-org/gemma-4-31B-GGUF
0 downloads · image-text-to-text
ggml-org/gemma-4-26B-A4B-GGUF
0 downloads · image-text-to-text
ggml-org/Qwen3-8B-Base-GGUF
0 downloads · text-generation
ggml-org/Qwen3-TTS-12Hz-1.7B-Base-GGUF
0 downloads ·
ggml-org/Qwen3.8-27B-GGUF
0 downloads · image-text-to-text
ggml-org/dots3-note-prev-GGUF
0 downloads ·
ggml-org/SmolLM2-135M-GGUF
0 downloads · text-generation
ggml-org/Llama-2-7B-GGUF
0 downloads · text-generation
ggml-org/GLM-4.5-Air-GGUF
0 downloads · text-generation
ggml-org/Qwen3.8-Flash-Next-GGUF
0 downloads · image-text-to-text
ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF
0 downloads · image-text-to-text

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models