GraySoft
Download guIDE →
Projects Models Compare Cloud benchmarks FAQ Download guIDE →

Granite 4.0 350M local alternatives

Cloud model by IBM. GGUF repos below are ranked by name match and downloads.

mradermacher/Solomon-Nano-350M-FP32-GGUF
mradermacher · 0 downloads
sandepaAI/medical-granite-350m-Q8-GGUF
sandepaAI · 0 downloads
MAOZEDONG5567/granite-4.0-350m-por-16384-GGUF
MAOZEDONG5567 · 0 downloads
cstr/granite-speech-4.1-2b-plus-GGUF
cstr · 2,649 downloads
mradermacher/Parable-Granite-4.1-3B-Claude-Fable-5-i1-GGUF
mradermacher · 1,483 downloads
cstr/granite-speech-4.1-2b-GGUF
cstr · 1,318 downloads
mradermacher/Mordant-3B-Think-i1-GGUF
mradermacher · 1,242 downloads
mrutkows/granite-4.1-3b-GGUF
mrutkows · 1,236 downloads
mradermacher/granite-speech-4.1-2b-plus-i1-GGUF
mradermacher · 1,161 downloads
cstr/granite-speech-4.0-1b-GGUF
cstr · 650 downloads
cstr/granite-speech-4.1-2b-nar-GGUF
cstr · 579 downloads
mradermacher/Mordant-3B-Think-GGUF
mradermacher · 463 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models