Models for 16 GB VRAM

Desktop-class 16 GB tier — higher quants and small multimodal models. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

unsloth/diffusiongemma-26B-A4B-it-GGUF

unsloth · from 15.65 GB · 284,055 downloads

AtomicChat/Laguna-XS-2.1-GGUF

AtomicChat · from 14.95 GB · 8,660 downloads

williamliao/Qwen3.6-27B-NVFP4-GGUF

williamliao · from 14.65 GB · 8,594 downloads

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

cHunter789 · from 13.14 GB · 7,933 downloads

EZForever/gemma-4-26B-A4B-it-qat-uncensored-heretic-UDmerge-GGUF

EZForever · from 13.27 GB · 5,491 downloads

el4/SIQ-1-35B-APEX-GGUF

el4 · from 15.40 GB · 4,406 downloads

Phil2Sat/Ornith-1.0-35B-AEON-Ultimate-Uncensored-MTP-APEX-I-Compact.gguf

Phil2Sat · from 15.75 GB · 4,351 downloads

maczzzzzz/Qwen3.6-27B-MTP-TQ3_4S-GGUF

maczzzzzz · from 13.19 GB · 2,708 downloads

smthem/SenseNova-U1-8B-MoT-Merger-gguf

smthem · from 12.93 GB · 2,550 downloads

ai-sage/GigaChat3.5-432B-A28B-GGUF

ai-sage · from 14.31 GB · 1,457 downloads

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-IQ4_XS

majentik · from 13.10 GB · 1,453 downloads

majentik/gemma-4-31B-RotorQuant-GGUF-IQ4_XS

majentik · from 15.70 GB · 1,256 downloads

majentik/gemma-4-31B-it-RotorQuant-GGUF-IQ4_XS

majentik · from 15.70 GB · 1,234 downloads

majentik/gemma-4-26B-A4B-RotorQuant-GGUF-IQ4_XS

majentik · from 13.10 GB · 1,214 downloads

FINAL-Bench/Darwin-28B-Coder-GGUF

FINAL-Bench · from 15.66 GB · 962 downloads

majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q4_K_M

majentik · from 14.82 GB · 937 downloads

jpetrina/ThinkingCap-Qwen3.6-27B-IQ4_XS-pure-GGUF

jpetrina · from 13.54 GB · 862 downloads

AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf

AbteeXAILab · from 15.78 GB · 854 downloads

s-batman/Qwen3.6-27B-NVFP4-MTP-GGUF

s-batman · from 14.64 GB · 802 downloads

AbteeXAILab/lumynax-infused-mistral-small-text-gguf

AbteeXAILab · from 13.35 GB · 752 downloads

tomvaillant/qwen3.6-27b-abliterated-journalist-GGUF

tomvaillant · from 15.41 GB · 629 downloads

mradermacher/Ornstein3.6-35B-A3B-GGUF

mradermacher · from 12.05 GB · 603 downloads

TaQuants/Tema_Q-X6-Thinking-TaQuants-GGUF

TaQuants · from 12.81 GB · 599 downloads

gwejgteheg/gemma-4-26B-A4B-it-qat-DeepSeek-distill-GGUF

gwejgteheg · from 15.64 GB · 566 downloads

coolthor/Huihui-Qwable-3.6-27b-abliterated-Q4_K_M-MTP-GGUF

coolthor · from 15.66 GB · 556 downloads

gorbatjovy/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-heretic-GGUF

gorbatjovy · from 15.66 GB · 507 downloads

darthcrawl/Lilith-31B-v1.0-GGUF

darthcrawl · from 13.43 GB · 497 downloads

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q4_K_M

majentik · from 15.64 GB · 457 downloads

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q3_K_M

majentik · from 15.61 GB · 446 downloads

jabbatheduck/OpenMythos-GGUF

jabbatheduck · from 15.41 GB · 429 downloads

maczzzzzz/Qwen3.6-27B-MTP-ROCmFP4_FAST-GGUF

maczzzzzz · from 13.54 GB · 425 downloads

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q3_K_M

majentik · from 12.37 GB · 409 downloads

fabxx48/GPT_OSS_20B_ArduinoExpert_v0.3_GGUF

fabxx48 · from 12.85 GB · 407 downloads

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q2_K

majentik · from 12.05 GB · 388 downloads

kintsugicollective/atlas-v18-gemma4-26b-q4-k-m-gguf

kintsugicollective · from 15.64 GB · 379 downloads

xCloudinfo/gpt-oss-20b-TAIDE-zhTW-GGUF

xCloudinfo · from 12.85 GB · 338 downloads

Jackxuanxuan/Gemma-4-31B-JANG_4M-CRACK-GGUF

Jackxuanxuan · from 14.24 GB · 338 downloads

freakyskittle/gemma-4-31B-it-AL-GGUF

freakyskittle · from 12.53 GB · 333 downloads

localweights/Qwen3.6-27B-MTP-IMAT-IQ4_XS-Q8nextn-GGUF

localweights · from 14.28 GB · 333 downloads

liodon-ai/Qwen3.6-35B-A3B-imatrix-GGUF

liodon-ai · from 12.05 GB · 329 downloads

majentik/gpt-oss-20b-RotorQuant-GGUF-Q4_K_M

majentik · from 14.72 GB · 300 downloads

h4rm0n1c/qwen3.5-24b-a3b-reap-0.32-iq4_nl-GGUF

h4rm0n1c · from 13.06 GB · 299 downloads

h4rm0n1c/qwen3.5-24b-a10b-IQ4_NL-GGUF

h4rm0n1c · from 12.93 GB · 295 downloads

majentik/gpt-oss-20b-RotorQuant-GGUF-Q3_K_M

majentik · from 12.03 GB · 294 downloads

majentik/gpt-oss-20b-RotorQuant-GGUF-Q5_K_M

majentik · from 15.73 GB · 294 downloads

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q3_K_M

majentik · from 14.24 GB · 284 downloads

mradermacher/L3.1-70b-MeowMix-i1-GGUF

mradermacher · from 14.29 GB · 280 downloads

majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q3_K_M

majentik · from 12.37 GB · 268 downloads

sh111111111111111/Qwen3.5-35B-A3B-BitClass3-GGUF

sh111111111111111 · from 14.01 GB · 266 downloads

mhndayesh/gemma-4-26B-A4B-netsec-expert-GGUF

mhndayesh · from 13.45 GB · 266 downloads

majentik/gemma-4-31B-RotorQuant-GGUF-Q3_K_M

majentik · from 14.24 GB · 265 downloads

uxix/MusaCoder-27B-GGUF

uxix · from 12.39 GB · 258 downloads

Bumoch/Evil-Vengeance-24B-V0.7-Heretic_Alpha-GGUF

Bumoch · from 13.35 GB · 254 downloads

Bumoch/Evil-Vengeance-24B-V0.X-Heretic_Alpha-GGUF

Bumoch · from 13.35 GB · 254 downloads

Bumoch/Evil-Vengeance-24B-V0.97-Alpha-GGUF

Bumoch · from 13.35 GB · 254 downloads

Bumoch/Evil-Vengeance-24B-V0.98-Alpha-GGUF

Bumoch · from 13.35 GB · 254 downloads

Bluerosesbutterfly/gemma-3-27b-it-abliterated.Q4_K_M.gguf

Bluerosesbutterfly · from 15.41 GB · 245 downloads

majentik/Qwen3.5-27B-RotorQuant-GGUF-IQ4_XS

majentik · from 14.15 GB · 244 downloads

Bumoch/Evil-Magical_Vengeance-GGUF

Bumoch · from 13.35 GB · 241 downloads

cHunter789/Qwen3.6-27B-i1-IQ4_KS_KT-GGUF

cHunter789 · from 13.09 GB · 186 downloads

mhndayesh/gemma-4-26B-A4B-offsec-expert-GGUF

mhndayesh · from 13.45 GB · 186 downloads

fraQtl/Gemma-4-26B-A4B-it-Hi-Fi-GGUF

fraQtl · from 15.94 GB · 165 downloads

mhndayesh/gemma-4-26B-A4B-dataplane-expert-GGUF

mhndayesh · from 13.45 GB · 162 downloads

SaadRahman/AMF-romantic-7b-F16-GGUF

SaadRahman · from 14.19 GB · 154 downloads

rabih6666/XORTRON-27B-JARVIS-GGUF

rabih6666 · from 15.41 GB · 152 downloads

fzxly/vee-gemma4-gguf

fzxly · from 15.64 GB · 131 downloads

SaadRahman/AMF-harrypotter-7b-F16-GGUF

SaadRahman · from 14.19 GB · 130 downloads

ApocalypseParty/G4-31B-SFT-v6-4-gguf

ApocalypseParty · from 13.43 GB · 108 downloads

alexokita/gemma4-style-step3000-GGUF

alexokita · from 15.64 GB · 107 downloads

majentik/Qwen3.5-27B-RotorQuant-GGUF-Q3_K_M

majentik · from 12.39 GB · 94 downloads

jpalmae/qwen27b-espanol-gguf

jpalmae · from 15.41 GB · 89 downloads

darkmaniac7/Qwen3.5-35B-A3B-heretic-v2-GGUF

darkmaniac7 · from 12.34 GB · 84 downloads

jebcarter/gemma-4-12b-heretic-styletune-head-GGUF

jebcarter · from 12.80 GB · 73 downloads

AlexHung29629/gemma-4-26B-openclaw-gguf

AlexHung29629 · from 13.72 GB · 68 downloads

latentdivergence/shadow-gemma-4-26B-A4B-it-GGUF

latentdivergence · from 15.87 GB · 65 downloads

majentik/Qwen3.5-27B-RotorQuant-GGUF-Q4_K_M

majentik · from 15.41 GB · 64 downloads

tbplong/hackaithon-finetune-3-gguf

tbplong · from 13.92 GB · 63 downloads

AbteeXAILab/lumynax-reasoning-deepseek-prover-v2-671b-gguf

AbteeXAILab · from 13.78 GB · 61 downloads

KikoCis/gemma-4-31b-it-IQ3_XS-GGUF

KikoCis · from 12.17 GB · 44 downloads

Srijan-Chakraborty/Qwen-AgentWorld-35B-A3B-Q2_K-GGUF

Srijan-Chakraborty · from 12.05 GB · 26 downloads

avlp12/Qwen3.5-35B-A3B-Alis-Ultra-GGUF

avlp12 · from 14.27 GB · 25 downloads

iamhsouna/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF

iamhsouna · from 15.64 GB · 24 downloads

SAPSAN-SKLEP/HIDra-30B-A3B-GGUF-uncensored-cybersec

SAPSAN-SKLEP · from 13.70 GB · 14 downloads

cafepm/GLM-4.7-Flash-Q3Q4-GGUF

cafepm · from 13.41 GB · 11 downloads

avlp12/Qwen3.5-35B-A3B-Alis-Ultra-Slim-GGUF

avlp12 · from 12.88 GB · 10 downloads

Renesas/Llama-3.1-8B-Instruct-GGUF

Renesas · from 14.97 GB · 9 downloads

KevininOne/Gemma-3-TAIDE-12b-Q8_0-GGUF

KevininOne · from 13.07 GB · 7 downloads

Fredred89/Qwopus3.6-27B-Coder-GGUF-Predator-Q

Fredred89 · from 12.65 GB · 5 downloads

AlexHung29629/gemma4-26b-openclaw-trl-v3-gguf

AlexHung29629 · from 13.72 GB · 5 downloads

sci4ai/Qwen3.6-27B-Abliterated-IQ4_XS.gguf

sci4ai · from 14.47 GB · 0 downloads

EnReaper/Dolphin-Mistral-24B-Venice-Edition-Q4_K_M-GGUF

EnReaper · from 13.35 GB · 0 downloads

bandtor/gemma-4-26B-A4B-it-GGUF

bandtor · from 15.78 GB · 0 downloads

Brunobkr/OFFELLIA_IQ4_XS_diffusiongemma-26B-A4B-it.gguf

Brunobkr · from 13.11 GB · 0 downloads

Brunobkr/OFFELLIA_MXFP4_MOE_diffusiongemma-26B-A4B-it.gguf

Brunobkr · from 13.73 GB · 0 downloads

brodatech/supergemma4-26b-uncensored-gguf-v2

brodatech · from 15.64 GB · 0 downloads

AlexAtomic/diffusiongemma-26B-A4B-it-GGUF

AlexAtomic · from 15.65 GB · 0 downloads

FreedomAISVR/North-Mini-Code-1.0-MXFP4-GGUF

FreedomAISVR · from 15.87 GB · 0 downloads

ShyliaSafetensors/TritonModelStock-24B-Q4_K_M-GGUF

ShyliaSafetensors · from 13.35 GB · 0 downloads

FreedomAISVR/GLM-4.7-Flash-MXFP4-MOE-GGUF

FreedomAISVR · from 15.80 GB · 0 downloads

FreedomAISVR/GLM-4.7-Flash-NVFP4-GGUF

FreedomAISVR · from 15.79 GB · 0 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models