granite model family

Top 120 granite models by Hugging Face downloads (205 total in catalog). Download GGUF files and run locally with guIDE.

In catalog

205

Downloads

565,089

AnkitAI/Parable-Granite-4.1-3B-Claude-Fable-5-GGUF

237,077 downloads

ibm-granite/granite-4.2-30b-GGUF

94,445 downloads

ibm-granite/granite-4.2-8b-GGUF

86,597 downloads

ibm-granite/granite-4.2-3b-GGUF

83,892 downloads

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF

44,570 downloads

cstr/granite-speech-4.1-2b-plus-GGUF

2,649 downloads

mradermacher/Parable-Granite-4.1-3B-Claude-Fable-5-i1-GGUF

1,483 downloads

cstr/granite-speech-4.1-2b-GGUF

1,318 downloads

mradermacher/Mordant-3B-Think-i1-GGUF

1,242 downloads

mradermacher/granite-speech-4.1-2b-plus-i1-GGUF

1,161 downloads

NANI-Nithin/granite-4.2-3b-GGUF

1,076 downloads

mrutkows/granite-4.1-3b-GGUF

1,028 downloads

cstr/granite-speech-4.0-1b-GGUF

650 downloads

cstr/granite-speech-4.1-2b-nar-GGUF

579 downloads

mradermacher/Mordant-3B-Think-GGUF

463 downloads

darioooooo0o/granite-4.2-8b-G-Q5-GGUF

441 downloads

mradermacher/Granite-4.1-8B-SFT-Fable5-GGUF

399 downloads

liodon-ai/granite-4.1-8b-imatrix-GGUF

375 downloads

mradermacher/Granite-4.1-8B-Function-Calling-xLAM-Unsloth-i1-GGUF

371 downloads

Myric/granite-4.0-h-tiny-APEX-GGUF

369 downloads

mradermacher/Granite-4.1-3B-Function-Calling-xLAM-Unsloth-i1-GGUF

358 downloads

barha/granite-switch-4.1-3b-preview-GGUF-pr25107

336 downloads

sanjanasrikanth/granite-embedding-small-english-r2-GGUF

319 downloads

mrutkows/granite-5.0-120b-sft-GGUF

286 downloads

ermiaazarkhalili/Granite-4.1-8B-SFT-Fable5-GGUF

277 downloads

mradermacher/Parable-Granite-4.1-3B-Claude-Fable-5-GGUF

244 downloads

mradermacher/Granite-4.1-8B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF

211 downloads

mradermacher/Granite-4.1-8B-Function-Calling-xLAM-Unsloth-GGUF

204 downloads

mradermacher/Granite-4.1-3B-SFT-Fable5-GGUF

194 downloads

ermiaazarkhalili/Granite-4.1-8B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

181 downloads

mradermacher/Granite-4.1-8B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

176 downloads

mradermacher/Granite-4.1-3B-Function-Calling-xLAM-Unsloth-GGUF

175 downloads

ermiaazarkhalili/Granite-4.1-3B-SFT-Fable5-GGUF

175 downloads

ertghiu256/Granite-4.1-3b-coder-gguf

155 downloads

tinyopsec/granite-4.2-3b-Heretic-GGUF

153 downloads

ermiaazarkhalili/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

145 downloads

ermiaazarkhalili/Granite-4.1-3B-Function-Calling-xLAM-Unsloth-GGUF

143 downloads

barha/granite-switch-4.1-3b-preview-GGUF

137 downloads

ermiaazarkhalili/Granite-4.1-8B-Function-Calling-xLAM-Unsloth-GGUF

125 downloads

mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF

95 downloads

roger33303/Jarvis_granite_4.1_3b_finetuned_gguf

88 downloads

ermiaazarkhalili/Granite-4.1-8B-SFT-Fable5-Glint-GGUF

88 downloads

ermiaazarkhalili/Granite-4.1-3B-SFT-Fable5-Glint-GGUF

79 downloads

cstr/granite-speech-3.3-8b-GGUF

77 downloads

mrutkows/granite-4.0-3b-vision-GGUF

74 downloads

cstr/granite-speech-3.2-8b-GGUF

53 downloads

cstr/granite-speech-3.3-2b-GGUF

49 downloads

mrutkows/granite-vision-4.1-4b-GGUF

47 downloads

nishparadox/granite-guardian-3.2-5b-multi-harm-GGUF

41 downloads

mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

34 downloads

mrutkows/granite-5.0-20b-sft-GGUF

31 downloads

Srijan-Chakraborty/granite-speech-4.1-2b-Q4_K_M-GGUF

25 downloads

mrutkows/granite-4.1-8b-GGUF

25 downloads

ibm-granite/granite-vision-4.1-4b-GGUF

17 downloads

AbteeXAILab/lumynax-infused-granite33-8b-gguf

16 downloads

AbteeXAILab/lumynax-infused-granite31-1b-a400m-gguf

15 downloads

lm-kit/granite-3.3-8b-instruct-gguf

15 downloads

AbteeXAILab/lumynax-infused-granite33-2b-gguf

11 downloads

nbdaaa/granite-docling-258M-mine-gguf

10 downloads

realoperator42/granite-4.1-3b-heretic-GGUF

10 downloads

mrutkows/granite-4.1-30b-GGUF

10 downloads

sillykiwi/spoomplesmaxx-cardmaker-v1-Q4_K_S-GGUF

0 downloads

Avtrkrb/granite-claude-h-350m-GGUF

0 downloads

mradermacher/granite-4.1-3b-reduced-prompt-injection-GGUF

0 downloads

Dzluck/granite-4.1-3b-Q4_K_M-GGUF

0 downloads

mradermacher/granite-3.3-8b-instruct-apostate-i1-GGUF

0 downloads

Dzluck/granite-3b-code-instruct-2k-GGUF

0 downloads

mradermacher/granite-3.3-8b-instruct-apostate-GGUF

0 downloads

NonMiFrega/granite-4.0-micro-Q4_K_M-GGUF

0 downloads

NonMiFrega/granite-4.0-h-micro-Q4_K_M-GGUF

0 downloads

Dzluck/granite-3.1-2b-instruct-GGUF

0 downloads

SandLogicTechnologies/granite-docling-258M-GGUF

0 downloads

Dzluck/Granite-3.3-2B-Instruct-BE-GGUF

0 downloads

Dzluck/granite-4.1-3b-Abliterated-AND-Disinhibited-i1-GGUF

0 downloads

ivgranite/Qwen-AgentWorld-35B-A3B-GGUF

0 downloads

Dzluck/granite-4.1-3b-GGUF

0 downloads

heterodoxin/granite-3.3-8b-instruct-apostate-gguf

0 downloads

mradermacher/Solomon-Nano-350M-FP32-GGUF

0 downloads

mradermacher/granite-speech-4.1-2b-plus-GGUF

0 downloads

mradermacher/spoomplesmaxx-v2.1-30B-GGUF

0 downloads

ermiaazarkhalili/granite-4.0-micro-GRPO-NuminaMath-20K-GGUF

0 downloads

mradermacher/spoomplesmaxx-v2.1-30B-i1-GGUF

0 downloads

mradermacher/granite-4.0-h-3b-ar-GGUF

0 downloads

ibm-granite/granite-speech-4.1-2b-plus-GGUF

0 downloads

mradermacher/granite-4.1-30b-heretic-GGUF

0 downloads

mradermacher/granite-4.0-h-3b-ar-i1-GGUF

0 downloads

mradermacher/granite-4.1-30b-heretic-i1-GGUF

0 downloads

andquant/granite-4.1-8b-fp8-Q8_0-GGUF

0 downloads

ApyHTML19/Granite-Vision-3.3-2B-Q_M_GGUF-F16

0 downloads

nurazwanh/granite-ansible-gguf

0 downloads

RockMan256/granite-docling-258M-GGUF

0 downloads

armandosds/granite-4.1-3b-GGUF

0 downloads

smarttasks/granite-3.3-8b-instruct-GGUF

0 downloads

memoravox/granite-speech-4.1-2b-plus-gguf

0 downloads

memoravox/granite-speech-4.1-2b-gguf

0 downloads

memoravox/granite-4.0-1b-speech-gguf

0 downloads

memoravox/granite-speech-4.1-2b-nar-gguf

0 downloads

mradermacher/Parable-Granite-4.1-8B-Claude-Fable-5-i1-GGUF

0 downloads

mradermacher/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF

0 downloads

liodon-ai/granite-4.1-3b-imatrix-GGUF

0 downloads

sandepaAI/medical-granite-350m-Q8-GGUF

0 downloads

sandepaAI/medical-granite-350m-GGUF

0 downloads

jamiefutch/granite-4.1-30b-GGUF

0 downloads

MAOZEDONG5567/granite-4.0-350m-por-16384-GGUF

0 downloads

mradermacher/pharos-judge-free-GGUF

0 downloads

mradermacher/Granite-4.1-3b-coder-GGUF

0 downloads

Stoned-Code/opusculum-350m-gguf

0 downloads

Skipti/antares-gguf-community

0 downloads

PhysShell/antares-1b-Q8_0-GGUF

0 downloads

mitkox/antares-1b-Q8_0-GGUF

0 downloads

AXONVERTEX-AI-RESEARCH/antares-350m-Q8_0-GGUF

0 downloads

AXONVERTEX-AI-RESEARCH/antares-1b-Q8_0-GGUF

0 downloads

mpribadi/antares-350m-Q8_0-GGUF

0 downloads

mpribadi/antares-1b-Q8_0-GGUF

0 downloads

bunny0417/antares-1b-GGUF

0 downloads

Myric/granite-4.0-h-small-APEX-GGUF

0 downloads

fenexxx/antares-1b-Q8_0-GGUF

0 downloads

HolkViking/antares-1b-Q8_0-GGUF

0 downloads

HolkViking/antares-1b-Q4_K_M-GGUF

0 downloads

kimi-chan/granite-4.1-30b-base-Q4_K_M-GGUF

0 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models