Models for 16 GB VRAM

Desktop-class 16 GB tier — higher quants and small multimodal models. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

mudler/KAT-Coder-V2.5-Dev-APEX-GGUF

mudler · from 12.54 GB · 456,578 downloads

unsloth/diffusiongemma-26B-A4B-it-GGUF

unsloth · from 15.65 GB · 284,055 downloads

handy-computer/Voxtral-Small-24B-2507-gguf

handy-computer · from 13.32 GB · 104,244 downloads

AnonimousA/Qwen3.8-Flash-Next-REAP-256-duo-GGUF

AnonimousA · from 12.83 GB · 65,745 downloads

mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-GGUF

mudler · from 13.33 GB · 39,835 downloads

orcarouter/OrcaSAQ-2-Cyber-27B-Uncensored-GGUF

orcarouter · from 14.60 GB · 27,694 downloads

smthem/SenseNova-U1-8B-MoT-Merger-gguf

smthem · from 12.93 GB · 25,734 downloads

XingChen-AGI/Xing4.0-29B-A4B-GGUF

XingChen-AGI · from 13.03 GB · 21,899 downloads

LiquidAI/LFM2.5-24B-A2B-GGUF

LiquidAI · from 12.65 GB · 17,807 downloads

williamliao/Qwen3.8-27B-NVFP4-GGUF

williamliao · from 14.96 GB · 15,042 downloads

mradermacher/decider-35b-a3b-GGUF

mradermacher · from 12.05 GB · 14,250 downloads

mudler/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-APEX-GGUF

mudler · from 13.33 GB · 11,174 downloads

jakeatx/Qwen3.8-27B-ATX-IQ4_XS-M-GGUF

jakeatx · from 14.52 GB · 9,476 downloads

mradermacher/Qwen3.6-35B-A3B-abliterated-GGUF

mradermacher · from 12.05 GB · 9,112 downloads

AtomicChat/DeepSeek-V4-Flash-0731-GGUF

AtomicChat · from 13.52 GB · 9,039 downloads

mudler/Qwen-AgentWorld-35B-A3B-APEX-GGUF

mudler · from 12.54 GB · 8,721 downloads

AtomicChat/Laguna-XS-2.1-GGUF

AtomicChat · from 14.95 GB · 8,660 downloads

williamliao/Qwen3.6-27B-NVFP4-GGUF

williamliao · from 14.65 GB · 8,594 downloads

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

cHunter789 · from 13.14 GB · 7,933 downloads

LiquidAI/LFM2-24B-A2B-GGUF

LiquidAI · from 12.54 GB · 7,768 downloads

esatapedico/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-NVFP4-GGUF

esatapedico · from 13.84 GB · 7,696 downloads

spiritfather/Boulesis-26B-A4B-i1-GGUF

spiritfather · from 13.33 GB · 7,448 downloads

gbuzhf/KAT-Coder-V2.5-Dev-MTP-GGUF

gbuzhf · from 13.38 GB · 7,442 downloads

openjev/openjev-GGUF

openjev · from 15.41 GB · 7,287 downloads

el4/GRM-3.2-Sky-OPAL-GGUF

el4 · from 15.78 GB · 7,015 downloads

mlasli/Qwen3.8-27B-Heretic-Uncensored-Q4_K_M-GGUF

mlasli · from 15.83 GB · 7,015 downloads

cHunter789/Qwen3.6-27B-i1-IQ4_KS_KT-GGUF

cHunter789 · from 13.09 GB · 6,858 downloads

wangzhang/Qwen3.6-27B-abliterated-GGUF

wangzhang · from 15.41 GB · 5,752 downloads

mudler/Qwen3.5-35B-A3B-Claude-Distilled-APEX-GGUF

mudler · from 13.33 GB · 5,661 downloads

EZForever/gemma-4-26B-A4B-it-qat-uncensored-heretic-UDmerge-GGUF

EZForever · from 13.27 GB · 5,491 downloads

kingjones777/Qwen3.8-Flash-Next-ROCmFP4-STRIX_LEAN-GGUF

kingjones777 · from 15.01 GB · 5,309 downloads

mlasli/Qwen3.8-27B-Heretic-Uncensored-IQ4_XS-GGUF

mlasli · from 14.47 GB · 5,213 downloads

cHunter789/Qwen3.8-27B-i1-IQ4_KS_KT-GGUF

cHunter789 · from 13.75 GB · 5,124 downloads

logic65/Whittle-Qwen-3.8-35B-A3B-GGUF

logic65 · from 15.58 GB · 4,916 downloads

logic65/Whittle-Next-27B-A3B-GGUF

logic65 · from 12.40 GB · 4,865 downloads

AI-conn/Huihui-Qwen3.8-27B-abliterated-GGUF

AI-conn · from 15.41 GB · 4,814 downloads

startlux-models/StartLux-Decision-v1-27B-Q4_K_M-GGUF

startlux-models · from 15.41 GB · 4,786 downloads

ubergarm/Qwen3.8-27B-GGUF

ubergarm · from 15.76 GB · 4,746 downloads

liodon-ai/Qwen3.6-35B-A3B-imatrix-GGUF

liodon-ai · from 12.05 GB · 4,602 downloads

mudler/Gemopus-4-26B-A4B-it-Preview-APEX-GGUF

mudler · from 12.09 GB · 4,564 downloads

Bucoid/Qwen3.8-27B-Heretic-Ara-16GB-VRAM-IQ4-XS-MTP-GGUF

Bucoid · from 12.76 GB · 4,459 downloads

IsValorum/XYZ-Aquila-mini-APEX-I-MiniPlus-V2.1-GGUF

IsValorum · from 13.74 GB · 4,449 downloads

IsValorum/Iris-mini-APEX-I-MiniPlus-V1-GGUF

IsValorum · from 13.82 GB · 4,080 downloads

IsValorum/Thomson-1.0-Small-APEX-I-MiniPlus-V2.1-GGUF

IsValorum · from 13.74 GB · 4,041 downloads

Bucoid/Qwen3.8-27B-Uncensored-IQ4-XS-MTP-16GB-VRAM-GGUF

Bucoid · from 12.95 GB · 4,013 downloads

esatapedico/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-GGUF

esatapedico · from 14.11 GB · 3,777 downloads

offmonreal/Ornith-1.5-35B-MaxQuality-MTP-GGUF

offmonreal · from 12.62 GB · 3,559 downloads

Bucoid/Qwen3.8-27B-Heretic-Ara-IQ4-XS-16GB-VRAM-GGUF

Bucoid · from 12.76 GB · 3,549 downloads

IsValorum/KAT-Coder-V2.5-Dev-APEX-I-MiniPlus-V2-GGUF

IsValorum · from 13.64 GB · 3,090 downloads

maczzzzzz/Qwen3.6-27B-MTP-TQ3_4S-GGUF

maczzzzzz · from 13.19 GB · 2,708 downloads

mudler/Carnice-MoE-35B-A3B-APEX-GGUF

mudler · from 13.33 GB · 2,623 downloads

brainnxdomain/Hemmingway-1-Heretic-MTP-GGUF

brainnxdomain · from 15.66 GB · 2,452 downloads

peculiar-ragdoll/Dagger-Qwen3.6-27B-GGUF-MTP

peculiar-ragdoll · from 12.57 GB · 2,153 downloads

soyaakinohara/K2-Horizon-32B-heretic-gguf

soyaakinohara · from 12.38 GB · 1,972 downloads

IsValorum/Xing4.0-29B-A4B-APEX-I-MiniPlus-V2.1-Abliterated-GGUF

IsValorum · from 12.82 GB · 1,911 downloads

mudler/Qwopus-MoE-35B-A3B-APEX-GGUF

mudler · from 13.33 GB · 1,861 downloads

fooooooooooooooooooooooooooooooooooooooooo/KAT-Coder-V2.5-Dev-16GB-MixedQuant-GGUF

fooooooooooooooooooooooooooooooooooooooooo · from 13.96 GB · 1,806 downloads

mudler/Qwen3.5-35B-A3B-APEX-TQ-GGUF

mudler · from 15.81 GB · 1,762 downloads

esatapedico/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NVFP4-GGUF

esatapedico · from 13.84 GB · 1,578 downloads

mradermacher/Llama-MagicalGirl-i1-GGUF

mradermacher · from 14.29 GB · 1,554 downloads

mradermacher/KAT-Ornith-Coder-35B-A3B-GGUF

mradermacher · from 12.05 GB · 1,553 downloads

mradermacher/Qwen3.6-35B-A3B-abliterated-v2-GGUF

mradermacher · from 12.05 GB · 1,494 downloads

ai-sage/GigaChat3.5-432B-A28B-GGUF

ai-sage · from 14.31 GB · 1,457 downloads

pugant/Qwen3.8-Flash-Next-ROCMFP4_STRIX_LEAN-GGUF

pugant · from 15.01 GB · 1,418 downloads

Myric/Qwen3.6-35B-A3B-APEX-GGUF

Myric · from 13.37 GB · 1,415 downloads

cafepm/G9v3-39A5B-Q3Q4-GGUF

cafepm · from 14.10 GB · 1,396 downloads

hyrelabs/Homura-30B-GGUF

hyrelabs · from 15.77 GB · 1,304 downloads

PaoAI/Qwen3.8-27B-PaoAI-ROCmFP4-STRIX-BALANCED-GGUF

PaoAI · from 13.98 GB · 1,295 downloads

Brunobkr/OFFFELLIA_gemma-4-26B-A4B-it-ultra-uncensored-heretic.gguf

Brunobkr · from 12.74 GB · 1,270 downloads

allura-quants/Qwen3.8-27B-Dominatrix-GGUF

allura-quants · from 15.66 GB · 1,256 downloads

frontier-infra/jebadiah-27b-GGUF

frontier-infra · from 15.66 GB · 1,232 downloads

OliviaRossi/4BeastsOfApocalypse-APEX-GGUF

OliviaRossi · from 14.55 GB · 1,209 downloads

Myric/Qwen3.5-35B-A3B-APEX-GGUF

Myric · from 13.37 GB · 1,162 downloads

hotdogs/Qwen3.8-27B-thinkingcap-abliterated-mtp-GGUF

hotdogs · from 15.66 GB · 1,146 downloads

offmonreal/KAT-Coder-V2.5-Dev-MaxQuality-MTP-GGUF

offmonreal · from 13.09 GB · 1,142 downloads

mradermacher/SignOfFour-GGUF

mradermacher · from 12.05 GB · 1,106 downloads

esatapedico/Muse-Glimmer-30B-NVFP4-GGUF

esatapedico · from 14.15 GB · 1,090 downloads

mradermacher/Juno-N-Coder-25B-A3B-GGUF

mradermacher · from 13.35 GB · 1,085 downloads

esatapedico/Qwen3.8-27B-NVFP4-BUDGET-GGUF

esatapedico · from 13.59 GB · 1,077 downloads

mradermacher/WikiQwen-35B-A3B-GGUF

mradermacher · from 12.05 GB · 1,071 downloads

mradermacher/Whittle-Qwen-3.8-35B-A3B-GGUF

mradermacher · from 12.08 GB · 1,051 downloads

Myric/K2-Horizon-MoVA-36B-A4B-APEX-GGUF

Myric · from 14.86 GB · 1,041 downloads

kataguru/Qwen3.5-35B-A3B-Jackripper-v1.0-Uncensored-GGUF

kataguru · from 12.07 GB · 1,000 downloads

FINAL-Bench/Darwin-28B-Coder-GGUF

FINAL-Bench · from 15.66 GB · 962 downloads

mradermacher/BigBang-Aquila-35B-Merged-Abliterated-GGUF

mradermacher · from 12.05 GB · 936 downloads

zSaiko/Pantheon-Reasoning-26B-A4B-1.1-V2-APEX-GGUF

zSaiko · from 13.04 GB · 933 downloads

soyaakinohara/gemma-4-31b-it-heretic-3.68bpw-14gb.gguf

soyaakinohara · from 13.18 GB · 929 downloads

bloomer010/Ling-3.0-flash-REAP176-46B-A5B-GGUF

bloomer010 · from 15.81 GB · 928 downloads

wayzer2321/Luna-27B-GGUF-Archive

wayzer2321 · from 12.57 GB · 906 downloads

wayzer2321/Luna-3.8-27B-GGUF

wayzer2321 · from 12.57 GB · 903 downloads

mradermacher/Anansi-35B-A3B-GGUF

mradermacher · from 12.05 GB · 882 downloads

jpetrina/ThinkingCap-Qwen3.6-27B-IQ4_XS-pure-GGUF

jpetrina · from 13.54 GB · 862 downloads

kataguru/Qwen3.8-27B-TWIN-TURBO-Fable-Finnish-GGUF

kataguru · from 12.57 GB · 858 downloads

Phil2Sat/TheDrummer_Orion-26B-A4B-v1-GGUF-I-Compact-MXFP4-GGUF

Phil2Sat · from 12.52 GB · 823 downloads

s-batman/Qwen3.6-27B-NVFP4-MTP-GGUF

s-batman · from 14.64 GB · 802 downloads

michaelw9999/Qwen3.6-27B-NVFP4-MXFP6-MTP-GGUF

michaelw9999 · from 15.24 GB · 792 downloads

esatapedico/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-NVFP4-GGUF

esatapedico · from 14.43 GB · 787 downloads

mradermacher/Llama-3.3-CURSEDMAGICALGIRL-2.5-i1-GGUF

mradermacher · from 14.29 GB · 762 downloads

thetom-ai/DeepSeek-V4-Flash-ConfigI-GGUF

thetom-ai · from 12.13 GB · 753 downloads

Abiray/OUI-1-GGUF

Abiray · from 12.38 GB · 753 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models