Models for 12 GB VRAM

Models that fit 12 GB VRAM with room for context and batching. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

mudler/Laguna-XS-2.1-APEX-GGUF

mudler · from 11.95 GB · 764,000 downloads

ibm-granite/granite-4.2-30b-GGUF

ibm-granite · from 10.11 GB · 94,445 downloads

bartowski/DeepSeek-V4-Flash-0731-GGUF

bartowski · from 10.15 GB · 42,913 downloads

tooltd/Qwen3.8-27B-IQ4-XS-16GB-VRAM-GGUF

tooltd · from 9.62 GB · 41,392 downloads

mudler/Qwen3.6-35B-A3B-APEX-MTP-GGUF

mudler · from 10.88 GB · 36,636 downloads

mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-MTP-GGUF

mudler · from 10.88 GB · 25,470 downloads

otheru/DeepSeek-V4-Flash-Strix-Halo-GGUF

otheru · from 10.15 GB · 22,995 downloads

mudler/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-APEX-MTP-GGUF

mudler · from 10.88 GB · 17,166 downloads

julianmb/Qwen-3.8-27B-ROCmFP4-FAST-GGUF

julianmb · from 8.57 GB · 15,617 downloads

mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-MTP-GGUF

mudler · from 10.88 GB · 13,781 downloads

el4/Qwopus3.6-35B-A3B-Coder-OPAL-GGUF

el4 · from 10.86 GB · 13,205 downloads

pearsonkyle/gemma-4-31b-it-imatrix-GGUF

pearsonkyle · from 10.17 GB · 12,447 downloads

realrebelai/Wan_Dancer_GGUFs

realrebelai · from 9.12 GB · 12,264 downloads

pearsonkyle/gemma-4-31B-it-awq-2bit-GGUF

pearsonkyle · from 10.17 GB · 12,187 downloads

el4/Darwin-36B-Opus-OPAL-GGUF

el4 · from 10.03 GB · 10,381 downloads

mudler/Qwen3.5-35B-A3B-Uncensored-FernflowerAI-APEX-GGUF

mudler · from 10.76 GB · 10,141 downloads

Brian6145/Qwen3.6-27B-Claude-Opus-DeepSeek-Distilled-Imatrix-MTP-GGUF

Brian6145 · from 10.12 GB · 9,601 downloads

Brian6145/Qwen3.6-27B-Claude-Opus-DeepSeek-Distilled-Imatrix-MTP-1M-GGUF

Brian6145 · from 10.12 GB · 8,906 downloads

bytkim/Qwen3.6-27B-MTP-pi-reasoning-GGUF

bytkim · from 10.15 GB · 8,169 downloads

Bahushruth/Qwen3.6-35B-A3B-abliterated-v4-GGUF

Bahushruth · from 10.86 GB · 6,915 downloads

Myric/KAT-Coder-V2.5-Dev-MTP-APEX-GGUF

Myric · from 11.86 GB · 6,509 downloads

comfyit/Wan22_Bernini_GGUF

comfyit · from 8.99 GB · 6,385 downloads

zerodigest/Qwen3.6-27B-YMQ-MTP-GGUF

zerodigest · from 9.33 GB · 6,218 downloads

Jackrong/Qwopus-GLM-18B-Merged-GGUF

Jackrong · from 9.16 GB · 5,656 downloads

mudler/Darwin-36B-Opus-APEX-GGUF

mudler · from 10.67 GB · 5,264 downloads

mradermacher/LFM2-24B-A2B-abliterated-GGUF

mradermacher · from 8.10 GB · 4,950 downloads

prometheusAIR/Ling-3.0-flash-GGUF

prometheusAIR · from 10.04 GB · 4,747 downloads

ewinregirgojr/Qwen3.8-14B-Instruct-Turbo-GGUF

ewinregirgojr · from 8.53 GB · 4,715 downloads

TheDrummer/Artemis-31B-v1.1-GGUF

TheDrummer · from 11.10 GB · 4,652 downloads

TheDrummer/Artemis-31B-v1-GGUF

TheDrummer · from 11.10 GB · 4,530 downloads

mudler/GLM-4.7-Flash-APEX-GGUF

mudler · from 11.11 GB · 4,194 downloads

Jianqiao1/Qwen3.6-27B-MTP-MoQ-GGUF

Jianqiao1 · from 10.07 GB · 4,075 downloads

mudler/NVIDIA-Nemotron-3-Super-120B-A12B-APEX-GGUF

mudler · from 8.29 GB · 3,742 downloads

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

huihui-ai · from 10.15 GB · 3,481 downloads

mudler/Qwen3-Coder-30B-APEX-GGUF

mudler · from 11.29 GB · 3,465 downloads

mudler/Qwopus3.6-35B-A3B-v1-APEX-MTP-GGUF

mudler · from 10.88 GB · 3,441 downloads

DavidAU/Command-R-01-Ultra-NEO-DARK-HORROR-V1-V2-35B-IMATRIX-GGUF

DavidAU · from 10.34 GB · 3,330 downloads

vcruz305/Laguna-S-2.1-GGUF

vcruz305 · from 10.56 GB · 3,280 downloads

TaQuants/Tema_Q-X4-Thinking-TaQuants-GGUF

TaQuants · from 10.30 GB · 3,268 downloads

DAXZEIT/GRM-2.6-Plus-0628-MTP-reasoning-i1-GGUF

DAXZEIT · from 10.14 GB · 3,246 downloads

Lucebox/DeepSeek-V4-Flash-DSpark-draft-GGUF

Lucebox · from 9.92 GB · 3,159 downloads

Lucebox/DeepSeek-V4-Flash-DSpark-Drafter-GGUF

Lucebox · from 9.92 GB · 3,159 downloads

Lucebox/DeepSeek-V4-Flash-0731-DSpark-GGUF

Lucebox · from 9.92 GB · 3,159 downloads

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

pearsonkyle · from 8.89 GB · 2,982 downloads

andreaborio/Qwen3.6-35B-A3B-Hebrus-GGUF

andreaborio · from 11.45 GB · 2,938 downloads

trjxter/Qwimi-3.6-27B-Coder-MTP-GGUF

trjxter · from 11.27 GB · 2,900 downloads

NikiKrutan/GRM-2.6-Plus-0628-MTP-GGUF

NikiKrutan · from 8.30 GB · 2,868 downloads

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

pearsonkyle · from 8.89 GB · 2,651 downloads

pearsonkyle/Qwopus3.6-27B-Coder-2bit-MTP-GGUF

pearsonkyle · from 8.89 GB · 2,558 downloads

mradermacher/Qwen3.6-27B-abliterated-v2-GGUF

mradermacher · from 9.98 GB · 2,394 downloads

AtomicChat/qwen3-coder-30b-a3b-GGUF

AtomicChat · from 10.49 GB · 2,383 downloads

bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF

bytkim · from 10.15 GB · 2,165 downloads

mradermacher/GLM-4.7-Flash-abliteratex-GGUF

mradermacher · from 10.28 GB · 1,993 downloads

DavidAU/L3.1-MOE-6X8B-Dark-Reasoning-Dantes-Peak-HORROR-R1-Uncensored-36B-GGUF

DavidAU · from 9.08 GB · 1,970 downloads

SUPEROXIDES/HIVEMIND_PREVIEW_32B_-_GGUF

SUPEROXIDES · from 8.40 GB · 1,958 downloads

DavidAU/MN-DARKEST-UNIVERSE-29B-GGUF

DavidAU · from 10.25 GB · 1,946 downloads

mradermacher/gemma-4-31B-it-abliterated-GGUF

mradermacher · from 11.10 GB · 1,889 downloads

mradermacher/Qwen3.8-27B-abliterated-GGUF

mradermacher · from 9.98 GB · 1,795 downloads

DavidAU/MN-Oblivion-26B-UNCENSORED-NEO-Imatrix-GGUF

DavidAU · from 9.15 GB · 1,784 downloads

mudler/LFM2-24B-A2B-APEX-GGUF

mudler · from 8.85 GB · 1,717 downloads

Joakimpalm-Zen/gpt-oss-20b-keep30-MXFP4-GGUF

Joakimpalm-Zen · from 10.68 GB · 1,620 downloads

offmonreal/Qwen3.8-27B-MaxQuality-iMatrix-GGUF

offmonreal · from 10.12 GB · 1,465 downloads

ozaa77/Cogito-0.9.1-15B-GGUF

ozaa77 · from 8.38 GB · 1,378 downloads

AtomicChat/qwen36-27b-GGUF

AtomicChat · from 9.98 GB · 1,371 downloads

exeterminal/Exe-Core-Dynamic-V1-GGUF

exeterminal · from 10.12 GB · 1,317 downloads

mradermacher/Qwen3.8-27B-abliteratex-GGUF

mradermacher · from 9.98 GB · 1,286 downloads

NikiKrutan/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-GGUF

NikiKrutan · from 8.50 GB · 1,249 downloads

mlasli/Qwen3.8-27B-Heretic-Uncensored-IQ2_M-GGUF

mlasli · from 9.74 GB · 1,241 downloads

Baekpica/K-EXAONE-236B-A23B-Mixed-Quant-GGUF

Baekpica · from 11.66 GB · 1,174 downloads

mradermacher/atlas-trm10-gemma4-26b-GGUF

mradermacher · from 9.86 GB · 1,147 downloads

Ttimms/Ornith-1.5-35B-A3B-REAP-50-GGUF

Ttimms · from 10.59 GB · 1,092 downloads

VaultLevel6/beaverai_gguf_backups

VaultLevel6 · from 11.88 GB · 1,091 downloads

FINAL-Bench/POCKET-26B-GGUF

FINAL-Bench · from 10.36 GB · 1,082 downloads

liodon-ai/Qwable-3.6-27b-imatrix-GGUF

liodon-ai · from 10.12 GB · 1,036 downloads

Mungert/Qwen3.8-27B-GGUF

Mungert · from 10.95 GB · 1,012 downloads

BeaverAI/Orion-26B-A4B-v1d-GGUF

BeaverAI · from 9.86 GB · 1,011 downloads

Ttimms/KAT-Coder-V2.5-Dev-REAP-50-GGUF

Ttimms · from 10.59 GB · 1,005 downloads

AlexAtomic/qwen3-coder-30b-a3b-GGUF

AlexAtomic · from 10.49 GB · 935 downloads

AbteeXAILab/lumynax-coder-deepseek-v2-lite-16b-gguf

AbteeXAILab · from 9.65 GB · 920 downloads

el4/SIQ-1-35B-OPAL-GGUF

el4 · from 10.03 GB · 908 downloads

AlexAtomic/qwen36-27b-GGUF

AlexAtomic · from 9.98 GB · 897 downloads

ccharnkij/Phi-4-Uncensored-GGUF

ccharnkij · from 8.44 GB · 891 downloads

Hob-forge/gpt-oss-20b-Q2_K-GGUF

Hob-forge · from 10.68 GB · 891 downloads

mradermacher/Qwen3.5-27B-abliterated-GGUF

mradermacher · from 9.98 GB · 873 downloads

crucible-labs/Qwen3.6-35B-A3B-REAP-48-Q3K-mixed-GGUF

crucible-labs · from 8.78 GB · 856 downloads

el4/Ornith-1.5-35B-A3B-ONYX-GGUF

el4 · from 11.23 GB · 855 downloads

ilintar/Ornith-1.0-35B-GGUF

ilintar · from 11.82 GB · 848 downloads

Myric/Laguna-XS-2.1-APEX-GGUF

Myric · from 11.25 GB · 818 downloads

IFM/K2-Horizon-3.7B-GGUF

IFM · from 9.43 GB · 800 downloads

sigmanih/Qwen-Qwen2.5-Coder-14B-Instruct-GGUF-Q4_K_M

sigmanih · from 8.37 GB · 764 downloads

mradermacher/Aurora-Code-1-GGUF

mradermacher · from 10.49 GB · 752 downloads

mradermacher/Gemma4-GarnetV3-31B-GGUF

mradermacher · from 11.10 GB · 727 downloads

kairusama/Qwen3.6-27B-Omnimerge-v4-MTP-IQ3_XXS-GGUF

kairusama · from 10.64 GB · 688 downloads

Iloqt/Versi-StyleTune-31B-GGUF

Iloqt · from 11.53 GB · 687 downloads

YanissAmz/DeepSeek-V4-Flash-DSpark-draft-GGUF

YanissAmz · from 10.15 GB · 667 downloads

deucebucket/Qwen3.6-27B-Cerebellum-GGUF

deucebucket · from 11.98 GB · 650 downloads

mradermacher/gpt-oss-20b-abliterated-GGUF

mradermacher · from 11.23 GB · 646 downloads

vinpix/Ternary-Bonsai-27B-Stock-MTP-GGUF

vinpix · from 8.18 GB · 641 downloads

cmndcntrlcyber/qwen14b-code-trainer-gguf

cmndcntrlcyber · from 8.37 GB · 637 downloads

ManniX-ITA/gemma-4-31b-he1-it-GGUF

ManniX-ITA · from 8.08 GB · 604 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models