Models for 16 GB VRAM

Desktop-class 16 GB tier — higher quants and small multimodal models. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

mudler/KAT-Coder-V2.5-Dev-APEX-GGUF

mudler · from 12.54 GB · 456,578 downloads

unsloth/diffusiongemma-26B-A4B-it-GGUF

unsloth · from 15.65 GB · 284,055 downloads

AnonimousA/Qwen3.8-Flash-Next-REAP-256-duo-GGUF

AnonimousA · from 12.83 GB · 65,745 downloads

mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-GGUF

mudler · from 13.33 GB · 39,835 downloads

smthem/SenseNova-U1-8B-MoT-Merger-gguf

smthem · from 12.93 GB · 25,734 downloads

cHunter789/Qwen3.8-27B-i1-IQ4_KS_KT-GGUF

cHunter789 · from 13.75 GB · 12,018 downloads

mudler/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-APEX-GGUF

mudler · from 13.33 GB · 11,174 downloads

AtomicChat/DeepSeek-V4-Flash-0731-GGUF

AtomicChat · from 13.52 GB · 9,039 downloads

mudler/Qwen-AgentWorld-35B-A3B-APEX-GGUF

mudler · from 12.54 GB · 8,721 downloads

AtomicChat/Laguna-XS-2.1-GGUF

AtomicChat · from 14.95 GB · 8,660 downloads

williamliao/Qwen3.6-27B-NVFP4-GGUF

williamliao · from 14.65 GB · 8,594 downloads

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

cHunter789 · from 13.14 GB · 7,933 downloads

LiquidAI/LFM2-24B-A2B-GGUF

LiquidAI · from 12.54 GB · 7,768 downloads

el4/GRM-3.2-Sky-OPAL-GGUF

el4 · from 15.78 GB · 7,015 downloads

mlasli/Qwen3.8-27B-Heretic-Uncensored-Q4_K_M-GGUF

mlasli · from 15.83 GB · 7,015 downloads

cHunter789/Qwen3.6-27B-i1-IQ4_KS_KT-GGUF

cHunter789 · from 13.09 GB · 6,858 downloads

offmonreal/Ornith-1.0-35B-MaxQuality-MTP-GGUF

offmonreal · from 13.09 GB · 5,945 downloads

wangzhang/Qwen3.6-27B-abliterated-GGUF

wangzhang · from 15.41 GB · 5,752 downloads

mudler/Qwen3.5-35B-A3B-Claude-Distilled-APEX-GGUF

mudler · from 13.33 GB · 5,661 downloads

EZForever/gemma-4-26B-A4B-it-qat-uncensored-heretic-UDmerge-GGUF

EZForever · from 13.27 GB · 5,491 downloads

esatapedico/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-NVFP4-GGUF

esatapedico · from 14.43 GB · 5,463 downloads

mlasli/Qwen3.8-27B-Heretic-Uncensored-IQ4_XS-GGUF

mlasli · from 14.47 GB · 5,213 downloads

esatapedico/Muse-Glimmer-30B-NVFP4-GGUF

esatapedico · from 14.15 GB · 5,169 downloads

ubergarm/Qwen3.8-27B-GGUF

ubergarm · from 15.76 GB · 4,746 downloads

liodon-ai/Qwen3.6-35B-A3B-imatrix-GGUF

liodon-ai · from 12.05 GB · 4,602 downloads

mudler/Gemopus-4-26B-A4B-it-Preview-APEX-GGUF

mudler · from 12.09 GB · 4,564 downloads

Bucoid/Qwen3.8-27B-Heretic-Ara-16GB-VRAM-IQ4-XS-MTP-GGUF

Bucoid · from 12.76 GB · 4,459 downloads

kingjones777/Qwen3.8-Flash-Next-ROCmFP4-STRIX_LEAN-GGUF

kingjones777 · from 15.01 GB · 4,204 downloads

Bucoid/Qwen3.8-27B-Uncensored-IQ4-XS-MTP-16GB-VRAM-GGUF

Bucoid · from 12.95 GB · 4,013 downloads

esatapedico/Qwen3.8-27B-NVFP4-BUDGET-GGUF

esatapedico · from 13.59 GB · 3,589 downloads

Bucoid/Qwen3.8-27B-Heretic-Ara-IQ4-XS-16GB-VRAM-GGUF

Bucoid · from 12.76 GB · 3,549 downloads

maczzzzzz/Qwen3.6-27B-MTP-TQ3_4S-GGUF

maczzzzzz · from 13.19 GB · 2,708 downloads

mudler/Carnice-MoE-35B-A3B-APEX-GGUF

mudler · from 13.33 GB · 2,623 downloads

peculiar-ragdoll/Dagger-Qwen3.6-27B-GGUF-MTP

peculiar-ragdoll · from 12.57 GB · 2,153 downloads

mudler/Qwopus-MoE-35B-A3B-APEX-GGUF

mudler · from 13.33 GB · 1,861 downloads

mudler/Qwen3.5-35B-A3B-APEX-TQ-GGUF

mudler · from 15.81 GB · 1,762 downloads

offmonreal/KAT-Coder-V2.5-Dev-MaxQuality-MTP-GGUF

offmonreal · from 13.09 GB · 1,646 downloads

ai-sage/GigaChat3.5-432B-A28B-GGUF

ai-sage · from 14.31 GB · 1,457 downloads

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-IQ4_XS

majentik · from 13.10 GB · 1,453 downloads

pugant/Qwen3.8-Flash-Next-ROCMFP4_STRIX_LEAN-GGUF

pugant · from 15.01 GB · 1,418 downloads

Myric/Qwen3.6-35B-A3B-APEX-GGUF

Myric · from 13.37 GB · 1,415 downloads

cafepm/G9v3-39A5B-Q3Q4-GGUF

cafepm · from 14.10 GB · 1,396 downloads

mradermacher/Qwen3.6-35B-A3B-abliterated-GGUF

mradermacher · from 12.05 GB · 1,360 downloads

hyrelabs/Homura-30B-GGUF

hyrelabs · from 15.77 GB · 1,304 downloads

majentik/gemma-4-31B-RotorQuant-GGUF-IQ4_XS

majentik · from 15.70 GB · 1,256 downloads

allura-quants/Qwen3.8-27B-Dominatrix-GGUF

allura-quants · from 15.66 GB · 1,256 downloads

ToastyPigeon/Other-Test-GGUFs

ToastyPigeon · from 15.66 GB · 1,241 downloads

majentik/gemma-4-31B-it-RotorQuant-GGUF-IQ4_XS

majentik · from 15.70 GB · 1,234 downloads

majentik/gemma-4-26B-A4B-RotorQuant-GGUF-IQ4_XS

majentik · from 13.10 GB · 1,214 downloads

OliviaRossi/4BeastsOfApocalypse-APEX-GGUF

OliviaRossi · from 14.55 GB · 1,209 downloads

Myric/Qwen3.5-35B-A3B-APEX-GGUF

Myric · from 13.37 GB · 1,162 downloads

hotdogs/Qwen3.8-27B-thinkingcap-abliterated-mtp-GGUF

hotdogs · from 15.66 GB · 1,146 downloads

mradermacher/SignOfFour-GGUF

mradermacher · from 12.05 GB · 1,106 downloads

mradermacher/Juno-N-Coder-25B-A3B-GGUF

mradermacher · from 13.35 GB · 1,085 downloads

Myric/K2-Horizon-MoVA-36B-A4B-APEX-GGUF

Myric · from 14.86 GB · 1,041 downloads

FINAL-Bench/Darwin-28B-Coder-GGUF

FINAL-Bench · from 15.66 GB · 962 downloads

majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q4_K_M

majentik · from 14.82 GB · 937 downloads

mradermacher/BigBang-Aquila-35B-Merged-Abliterated-GGUF

mradermacher · from 12.05 GB · 936 downloads

bloomer010/Ling-3.0-flash-REAP176-46B-A5B-GGUF

bloomer010 · from 15.81 GB · 928 downloads

vcruz305/Kimi-K3-GGUF

vcruz305 · from 12.05 GB · 919 downloads

jpetrina/ThinkingCap-Qwen3.6-27B-IQ4_XS-pure-GGUF

jpetrina · from 13.54 GB · 862 downloads

s-batman/Qwen3.6-27B-NVFP4-MTP-GGUF

s-batman · from 14.64 GB · 802 downloads

michaelw9999/Qwen3.6-27B-NVFP4-MXFP6-MTP-GGUF

michaelw9999 · from 15.24 GB · 792 downloads

thetom-ai/DeepSeek-V4-Flash-ConfigI-GGUF

thetom-ai · from 12.13 GB · 753 downloads

quark75/Qwen3.8-27B-MXFP4-GGUF

quark75 · from 15.71 GB · 740 downloads

mradermacher/Llama-3.3-MagicalGirl-2.5-i1-GGUF

mradermacher · from 14.29 GB · 729 downloads

tomvaillant/qwen3.6-27b-abliterated-journalist-GGUF

tomvaillant · from 15.41 GB · 629 downloads

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q2_K

majentik · from 12.05 GB · 629 downloads

mradermacher/Ornstein3.6-35B-A3B-GGUF

mradermacher · from 12.05 GB · 603 downloads

Myric/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-APEX-GGUF

Myric · from 13.66 GB · 602 downloads

TaQuants/Tema_Q-X6-Thinking-TaQuants-GGUF

TaQuants · from 12.81 GB · 599 downloads

Myric/KAT-Coder-V2.5-Dev-APEX-GGUF

Myric · from 12.67 GB · 595 downloads

poisonxa/Qwable-27B-GGUF

poisonxa · from 14.60 GB · 569 downloads

julianmb/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-ROCmFP4-GGUF

julianmb · from 15.66 GB · 559 downloads

coolthor/Huihui-Qwable-3.6-27b-abliterated-Q4_K_M-MTP-GGUF

coolthor · from 15.66 GB · 556 downloads

jakeatx/Qwen3.8-27B-ATX-IQ4_XS-M-GGUF

jakeatx · from 14.52 GB · 555 downloads

lmcoleman/Tess-4-27B-ROCmFPX-GGUF

lmcoleman · from 14.09 GB · 538 downloads

gorbatjovy/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-heretic-GGUF

gorbatjovy · from 15.66 GB · 507 downloads

darthcrawl/Lilith-31B-v1.0-GGUF

darthcrawl · from 13.43 GB · 497 downloads

lmcoleman/Qwen3.6-35B-A3B-BUDGET-GGUF

lmcoleman · from 13.51 GB · 478 downloads

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q4_K_M

majentik · from 15.64 GB · 457 downloads

FedericoSciuca/Qwen3.6-35B-A3B-depthaware-GGUF

FedericoSciuca · from 13.15 GB · 432 downloads

mradermacher/BigBang-Aquila-35B-Merged-GGUF

mradermacher · from 12.05 GB · 431 downloads

jabbatheduck/OpenMythos-GGUF

jabbatheduck · from 15.41 GB · 429 downloads

maczzzzzz/Qwen3.6-27B-MTP-ROCmFP4_FAST-GGUF

maczzzzzz · from 13.54 GB · 425 downloads

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q3_K_M

majentik · from 15.61 GB · 420 downloads

mradermacher/Qwen3.5-35B-A3B-abliterated-GGUF

mradermacher · from 12.05 GB · 412 downloads

wangzhang/gpt-oss-20b-abliterated-GGUF

wangzhang · from 14.72 GB · 410 downloads

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q3_K_M

majentik · from 12.37 GB · 409 downloads

fabxx48/GPT_OSS_20B_ArduinoExpert_v0.3_GGUF

fabxx48 · from 12.85 GB · 407 downloads

Shadowplague/Gemory-26B-A4B-NVFP4-GGUF

Shadowplague · from 14.26 GB · 407 downloads

Koshkasa/TheDrummer_Skyfall-31B-v4.2-IQ4_KSS-GGUF

Koshkasa · from 14.27 GB · 391 downloads

sigmanih/Qwen3.8-27B-GGUF-Q4_K_S

sigmanih · from 14.74 GB · 386 downloads

pugant/Qwen3.8-Flash-Next-Q4_0_ROCMFP4_STRIX_LEAN-GGUF

pugant · from 15.01 GB · 384 downloads

kintsugicollective/atlas-v18-gemma4-26b-q4-k-m-gguf

kintsugicollective · from 15.64 GB · 379 downloads

Alberto-Codes/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-fit16gib-GGUF

Alberto-Codes · from 15.76 GB · 369 downloads

fraQtl/Gemma-4-26B-A4B-it-Hi-Fi-GGUF

fraQtl · from 15.94 GB · 368 downloads

el4/SIQ-1-35B-APEX-GGUF

el4 · from 15.40 GB · 356 downloads

kingjones777/North-Mini-Code-1.0-ROCmFP4-STRIX-GGUF

kingjones777 · from 15.28 GB · 350 downloads

xCloudinfo/gpt-oss-20b-TAIDE-zhTW-GGUF

xCloudinfo · from 12.85 GB · 338 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models