GraySoft
Download guIDE →
Projects Models Compare Cloud benchmarks FAQ Download guIDE →

ggml-org author hub

Nemotron Nano 3 30B A3B Run with https://llama.app bash llama serve hf ggml org/Nemotron Nano 3 30B A3B GGUF Source models https://huggingface.co/nvidia/NVIDIA Nemotron 3 Nano 30B A3B BF16 TODOs add info add MTP IMPORTANT This model is automatically converted using https://githu…

Models
24
Downloads
368,312
ggml-org/gemma-4-26B-A4B-it-GGUF
224,111 downloads · image-text-to-text
ggml-org/gpt-oss-20b-GGUF
48,439 downloads · text-generation
ggml-org/DeepSeek-V4-Flash-0731-GGUF
21,986 downloads · text-generation
ggml-org/Qwen3-0.6B-GGUF
20,152 downloads · text-generation
ggml-org/gpt-oss-120b-GGUF
17,442 downloads · text-generation
ggml-org/gemma-4-31B-it-GGUF
13,133 downloads · image-text-to-text
ggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF
5,894 downloads ·
ggml-org/Qwen3.6-27B-GGUF
4,735 downloads · image-text-to-text
ggml-org/Qwen3.6-35B-A3B-GGUF
3,515 downloads · image-text-to-text
ggml-org/Nemotron-Nano-3-30B-A3B-GGUF
2,727 downloads · text-generation
ggml-org/DeepSeek-V4-Flash-GGUF
2,641 downloads · text-generation
ggml-org/Qwen3-8B-GGUF
2,043 downloads · text-generation
ggml-org/Qwen3.5-0.8B-GGUF
927 downloads · image-text-to-text
ggml-org/Qwen3.5-0.8B-Base-GGUF
416 downloads · image-text-to-text
ggml-org/LongCat-Flash-Chat-GGUF
151 downloads ·
ggml-org/Qwen3-0.6B-Base-GGUF
0 downloads · text-generation
ggml-org/gemma-4-31B-GGUF
0 downloads · image-text-to-text
ggml-org/gemma-4-26B-A4B-GGUF
0 downloads · image-text-to-text
ggml-org/Qwen3-8B-Base-GGUF
0 downloads · text-generation
ggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF
0 downloads · text-generation
ggml-org/Laguna-XS-2.1-GGUF
0 downloads · text-generation
ggml-org/Qwen3-TTS-12Hz-1.7B-Base-GGUF
0 downloads ·
ggml-org/Laguna-S-2.1-GGUF
0 downloads · text-generation
ggml-org/Qwen3.8-27B-GGUF
0 downloads · image-text-to-text

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models