granite model family

Top 120 granite models by Hugging Face downloads (312 total in catalog). Download GGUF files and run locally with guIDE.

In catalog

312

Downloads

1,097,359

AnkitAI/Parable-Granite-4.1-3B-Claude-Fable-5-GGUF

350,851 downloads

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF

347,023 downloads

ibm-granite/granite-4.2-30b-GGUF

94,445 downloads

ibm-granite/granite-4.2-8b-GGUF

86,597 downloads

ibm-granite/granite-4.2-3b-GGUF

83,892 downloads

handy-computer/granite-speech-4.1-2b-nar-gguf

42,639 downloads

handy-computer/granite-speech-4.1-2b-gguf

38,925 downloads

handy-computer/granite-4.0-1b-speech-gguf

14,227 downloads

handy-computer/granite-speech-4.1-2b-plus-gguf

12,452 downloads

cstr/granite-speech-4.1-2b-plus-GGUF

2,649 downloads

mradermacher/Parable-Granite-4.1-3B-Claude-Fable-5-i1-GGUF

1,483 downloads

cstr/granite-speech-4.1-2b-GGUF

1,318 downloads

mradermacher/Mordant-3B-Think-i1-GGUF

1,242 downloads

mradermacher/granite-speech-4.1-2b-plus-i1-GGUF

1,161 downloads

NANI-Nithin/granite-4.2-3b-GGUF

1,076 downloads

mrutkows/granite-4.1-3b-GGUF

1,028 downloads

webmp3/Sakura-granite-4.2-8b-GGUF

948 downloads

mradermacher/granite-4.1-30b-abliterated-i1-GGUF

871 downloads

handy-computer/granite-speech-5.0-470m-turboctc-gguf

799 downloads

cstr/granite-speech-4.0-1b-GGUF

650 downloads

mradermacher/granite-4.1-8b-abliterated-i1-GGUF

630 downloads

richardyoung/granite-4.2-3b-heretic-GGUF

612 downloads

cstr/granite-speech-4.1-2b-nar-GGUF

579 downloads

mradermacher/granite-4.1-30b-abliterated-GGUF

515 downloads

mradermacher/Mordant-3B-Think-GGUF

463 downloads

darioooooo0o/granite-4.2-8b-G-Q5-GGUF

441 downloads

mradermacher/granite-speech-4.1-2b-GGUF

441 downloads

handy-computer/granite-speech-5.0-470m-turboctc-nc-gguf

426 downloads

mradermacher/Granite-4.1-8B-SFT-Fable5-GGUF

399 downloads

liodon-ai/granite-4.1-8b-imatrix-GGUF

375 downloads

mradermacher/Granite-4.1-8B-Function-Calling-xLAM-Unsloth-i1-GGUF

371 downloads

Myric/granite-4.0-h-tiny-APEX-GGUF

369 downloads

mradermacher/Granite-4.1-3B-Function-Calling-xLAM-Unsloth-i1-GGUF

358 downloads

barha/granite-switch-4.1-3b-preview-GGUF-pr25107

336 downloads

mradermacher/granite-4.1-8b-abliterated-GGUF

309 downloads

mradermacher/granite-cermat-cz-7b-GGUF

297 downloads

mradermacher/granite-speech-4.1-2b-plus-GGUF

290 downloads

mrutkows/granite-5.0-120b-sft-GGUF

286 downloads

ermiaazarkhalili/Granite-4.1-8B-SFT-Fable5-GGUF

277 downloads

simpledirect/Vinci-Cyber-8B-1.0-GGUF

268 downloads

mradermacher/Parable-Granite-4.1-3B-Claude-Fable-5-GGUF

244 downloads

mradermacher/Granite-4.1-8B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF

211 downloads

mradermacher/Granite-4.1-8B-Function-Calling-xLAM-Unsloth-GGUF

204 downloads

mradermacher/granite-4.1-3b-reduced-prompt-injection-GGUF

200 downloads

mradermacher/Granite-4.1-3B-SFT-Fable5-GGUF

194 downloads

richardyoung/granite-4.2-8b-heretic-GGUF

193 downloads

mrutkows/granite-4.0-3b-vision-GGUF

184 downloads

ermiaazarkhalili/Granite-4.1-8B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

181 downloads

mradermacher/Granite-4.1-8B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

176 downloads

mradermacher/Granite-4.1-3B-Function-Calling-xLAM-Unsloth-GGUF

175 downloads

ermiaazarkhalili/Granite-4.1-3B-SFT-Fable5-GGUF

175 downloads

mradermacher/granite-4.0-1b-speech-GGUF

171 downloads

ertghiu256/Granite-4.1-3b-coder-gguf

155 downloads

tinyopsec/granite-4.2-3b-Heretic-GGUF

153 downloads

mradermacher/granite-speech-3.3-8b-GGUF

153 downloads

ermiaazarkhalili/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

145 downloads

ermiaazarkhalili/Granite-4.1-3B-Function-Calling-xLAM-Unsloth-GGUF

143 downloads

barha/granite-switch-4.1-3b-preview-GGUF

137 downloads

mradermacher/Vinci-Cyber-30B-1.0-GGUF

133 downloads

ermiaazarkhalili/Granite-4.1-8B-Function-Calling-xLAM-Unsloth-GGUF

125 downloads

mradermacher/granite-speech-3.3-2b-GGUF

123 downloads

mradermacher/Docket-3B-GGUF

110 downloads

mradermacher/granite-4.0-h-small-heretic_med-GGUF

104 downloads

Vakamalla-Anitha/granite-4.1-3b-oracle-text-to-sql-gguf

103 downloads

mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-i1-GGUF

95 downloads

roger33303/Jarvis_granite_4.1_3b_finetuned_gguf

88 downloads

ermiaazarkhalili/Granite-4.1-8B-SFT-Fable5-Glint-GGUF

88 downloads

ermiaazarkhalili/Granite-4.1-3B-SFT-Fable5-Glint-GGUF

79 downloads

cstr/granite-speech-3.3-8b-GGUF

77 downloads

simpledirect/Vinci-Cyber-30B-1.0-GGUF

60 downloads

cstr/granite-speech-3.2-8b-GGUF

53 downloads

llmware/dragon-granite-8b-gguf

52 downloads

KittyLM/kittylm-granite-4.2-3b-gguf

51 downloads

cstr/granite-speech-3.3-2b-GGUF

49 downloads

sanjanasrikanth/granite-embedding-small-english-r2-GGUF

44 downloads

Vakamalla-Anitha/oracle19c-nl2sql-granite-4.1-3b-gguf

43 downloads

mrutkows/granite-vision-4.1-4b-GGUF

42 downloads

nishparadox/granite-guardian-3.2-5b-multi-harm-GGUF

41 downloads

mradermacher/Granite-4.1-3B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

34 downloads

mrutkows/granite-4.1-30b-GGUF

34 downloads

mrutkows/granite-5.0-20b-sft-GGUF

31 downloads

stefanberger/granite-embedding-125m-english-GGUF

26 downloads

Srijan-Chakraborty/granite-speech-4.1-2b-Q4_K_M-GGUF

25 downloads

mrutkows/granite-4.1-8b-GGUF

25 downloads

ibm-granite/granite-vision-4.1-4b-GGUF

17 downloads

AbteeXAILab/lumynax-infused-granite33-8b-gguf

16 downloads

AbteeXAILab/lumynax-infused-granite31-1b-a400m-gguf

15 downloads

lm-kit/granite-3.3-8b-instruct-gguf

15 downloads

realoperator42/granite-4.1-3b-heretic-GGUF

12 downloads

AbteeXAILab/lumynax-infused-granite33-2b-gguf

11 downloads

nbdaaa/granite-docling-258M-mine-gguf

11 downloads

TunedChaos/ChaosNexus_Tuned_v1-GGUF

9 downloads

simpledirect/Vinci-MLE-8B-1.0-GGUF

4 downloads

mradermacher/kiesel-v2-i1-GGUF

2 downloads

sillykiwi/spoomplesmaxx-cardmaker-v1-Q4_K_S-GGUF

0 downloads

Avtrkrb/granite-claude-h-350m-GGUF

0 downloads

Dzluck/granite-4.1-3b-Q4_K_M-GGUF

0 downloads

mradermacher/granite-3.3-8b-instruct-apostate-i1-GGUF

0 downloads

Dzluck/granite-3b-code-instruct-2k-GGUF

0 downloads

mradermacher/granite-3.3-8b-instruct-apostate-GGUF

0 downloads

NonMiFrega/granite-4.0-micro-Q4_K_M-GGUF

0 downloads

NonMiFrega/granite-4.0-h-micro-Q4_K_M-GGUF

0 downloads

Dzluck/granite-3.1-2b-instruct-GGUF

0 downloads

SandLogicTechnologies/granite-docling-258M-GGUF

0 downloads

Dzluck/Granite-3.3-2B-Instruct-BE-GGUF

0 downloads

Dzluck/granite-4.1-3b-Abliterated-AND-Disinhibited-i1-GGUF

0 downloads

ivgranite/Qwen-AgentWorld-35B-A3B-GGUF

0 downloads

Dzluck/granite-4.1-3b-GGUF

0 downloads

heterodoxin/granite-3.3-8b-instruct-apostate-gguf

0 downloads

mradermacher/Solomon-Nano-350M-FP32-GGUF

0 downloads

mradermacher/spoomplesmaxx-v2.1-30B-GGUF

0 downloads

ermiaazarkhalili/granite-4.0-micro-GRPO-NuminaMath-20K-GGUF

0 downloads

mradermacher/spoomplesmaxx-v2.1-30B-i1-GGUF

0 downloads

mradermacher/granite-4.0-h-3b-ar-GGUF

0 downloads

ibm-granite/granite-speech-4.1-2b-plus-GGUF

0 downloads

mradermacher/granite-4.1-30b-heretic-GGUF

0 downloads

mradermacher/granite-4.0-h-3b-ar-i1-GGUF

0 downloads

mradermacher/granite-4.1-30b-heretic-i1-GGUF

0 downloads

andquant/granite-4.1-8b-fp8-Q8_0-GGUF

0 downloads

ApyHTML19/Granite-Vision-3.3-2B-Q_M_GGUF-F16

0 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models