GraySoft
Download guIDE →
Projects Models Compare Cloud benchmarks FAQ Download guIDE →

Granite 4.0 H 350M local alternatives

Cloud model by IBM. GGUF repos below are ranked by name match and downloads.

mradermacher/Solomon-Nano-350M-FP32-GGUF
mradermacher · 0 downloads
sandepaAI/medical-granite-350m-Q8-GGUF
sandepaAI · 0 downloads
MAOZEDONG5567/granite-4.0-350m-por-16384-GGUF
MAOZEDONG5567 · 0 downloads
taronaeo/Granite-4.0-350M-BE-GGUF
taronaeo · 0 downloads
taronaeo/Granite-4.0-H-350M-BE-GGUF
taronaeo · 0 downloads
ibm-granite/granite-4.2-3b-GGUF
ibm-granite · 83,892 downloads
handy-computer/granite-speech-4.1-2b-nar-gguf
handy-computer · 42,639 downloads
handy-computer/granite-speech-4.1-2b-gguf
handy-computer · 38,925 downloads
handy-computer/granite-4.0-1b-speech-gguf
handy-computer · 14,227 downloads
handy-computer/granite-speech-4.1-2b-plus-gguf
handy-computer · 12,452 downloads
cstr/granite-speech-4.1-2b-plus-GGUF
cstr · 2,649 downloads
mradermacher/Parable-Granite-4.1-3B-Claude-Fable-5-i1-GGUF
mradermacher · 1,483 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models