Models for 12 GB VRAM

Models that fit 12 GB VRAM with room for context and batching. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

mudler/Laguna-XS-2.1-APEX-GGUF

mudler · from 11.95 GB · 764,000 downloads

FINAL-Bench/POCKET-26B-GGUF

FINAL-Bench · from 10.36 GB · 238,652 downloads

mradermacher/Hemmingway-1-GGUF

mradermacher · from 10.12 GB · 102,090 downloads

ibm-granite/granite-4.2-30b-GGUF

ibm-granite · from 10.11 GB · 94,445 downloads

tooltd/Qwen3.8-27B-IQ4-XS-16GB-VRAM-GGUF

tooltd · from 9.62 GB · 53,624 downloads

bartowski/DeepSeek-V4-Flash-0731-GGUF

bartowski · from 10.15 GB · 42,913 downloads

soyaakinohara/qwen3.8-27b-abliterated-3.69bpw-12GB-MTP.gguf

soyaakinohara · from 11.73 GB · 37,250 downloads

mudler/Qwen3.6-35B-A3B-APEX-MTP-GGUF

mudler · from 10.88 GB · 36,636 downloads

Hob-forge/Kolibri-1-GGUF

Hob-forge · from 10.10 GB · 26,327 downloads

mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-MTP-GGUF

mudler · from 10.88 GB · 25,470 downloads

otheru/DeepSeek-V4-Flash-Strix-Halo-GGUF

otheru · from 10.15 GB · 22,995 downloads

mradermacher/GRM-2.6-Plus-Primal-GGUF

mradermacher · from 9.98 GB · 17,656 downloads

mudler/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-APEX-MTP-GGUF

mudler · from 10.88 GB · 17,166 downloads

AMAImedia/DeepSeek-V4.1-Flash-FP8-GGUF

AMAImedia · from 9.22 GB · 16,626 downloads

julianmb/Qwen-3.8-27B-ROCmFP4-FAST-GGUF

julianmb · from 8.57 GB · 15,617 downloads

startlux-models/StartLux-Decision-v1-9B-Q8_0-GGUF

startlux-models · from 8.87 GB · 13,851 downloads

mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-MTP-GGUF

mudler · from 10.88 GB · 13,781 downloads

el4/Qwopus3.6-35B-A3B-Coder-OPAL-GGUF

el4 · from 10.86 GB · 13,205 downloads

pottokao/MiniMax-H3-TextEncoder-Qwen3VL-32B-abliterated-GGUF

pottokao · from 10.67 GB · 12,529 downloads

pearsonkyle/gemma-4-31b-it-imatrix-GGUF

pearsonkyle · from 10.17 GB · 12,447 downloads

realrebelai/Wan_Dancer_GGUFs

realrebelai · from 9.12 GB · 12,264 downloads

pearsonkyle/gemma-4-31B-it-awq-2bit-GGUF

pearsonkyle · from 10.17 GB · 12,187 downloads

mradermacher/Qwen3.8-Whittle-MoE-27B-A17.8B-GGUF

mradermacher · from 10.55 GB · 11,129 downloads

mradermacher/Qwen3.8-27B-abliterated-GGUF

mradermacher · from 9.98 GB · 10,771 downloads

el4/Darwin-36B-Opus-OPAL-GGUF

el4 · from 10.03 GB · 10,381 downloads

mudler/Qwen3.5-35B-A3B-Uncensored-FernflowerAI-APEX-GGUF

mudler · from 10.76 GB · 10,141 downloads

Brian6145/Qwen3.6-27B-Claude-Opus-DeepSeek-Distilled-Imatrix-MTP-GGUF

Brian6145 · from 10.12 GB · 9,601 downloads

Brian6145/Qwen3.6-27B-Claude-Opus-DeepSeek-Distilled-Imatrix-MTP-1M-GGUF

Brian6145 · from 10.12 GB · 8,906 downloads

bytkim/Qwen3.6-27B-MTP-pi-reasoning-GGUF

bytkim · from 10.15 GB · 8,169 downloads

ayozhee/Qwen3.8-27B-Abliterated-GSQ-Orca-GGUF

ayozhee · from 8.95 GB · 8,027 downloads

DrMoriarty0/Qwen3.5-35B-A3B-GGUF

DrMoriarty0 · from 9.24 GB · 7,076 downloads

Bahushruth/Qwen3.6-35B-A3B-abliterated-v4-GGUF

Bahushruth · from 10.86 GB · 6,915 downloads

mradermacher/Gemma-4-26B-A4B-StyleTune-V2-GGUF

mradermacher · from 10.08 GB · 6,701 downloads

Myric/KAT-Coder-V2.5-Dev-MTP-APEX-GGUF

Myric · from 11.86 GB · 6,509 downloads

comfyit/Wan22_Bernini_GGUF

comfyit · from 8.99 GB · 6,385 downloads

zerodigest/Qwen3.6-27B-YMQ-MTP-GGUF

zerodigest · from 9.33 GB · 6,218 downloads

mradermacher/Split-Untied-31B-GGUF

mradermacher · from 11.53 GB · 5,772 downloads

Jackrong/Qwopus-GLM-18B-Merged-GGUF

Jackrong · from 9.16 GB · 5,656 downloads

Greatjedi/Qwen3.8-27B-Intel-Arc-Tuned-GGUF

Greatjedi · from 10.47 GB · 5,458 downloads

mudler/Darwin-36B-Opus-APEX-GGUF

mudler · from 10.67 GB · 5,264 downloads

mradermacher/LFM2-24B-A2B-abliterated-GGUF

mradermacher · from 8.10 GB · 4,950 downloads

prometheusAIR/Ling-3.0-flash-GGUF

prometheusAIR · from 10.04 GB · 4,747 downloads

ewinregirgojr/Qwen3.8-14B-Instruct-Turbo-GGUF

ewinregirgojr · from 8.53 GB · 4,715 downloads

TheDrummer/Artemis-31B-v1.1-GGUF

TheDrummer · from 11.10 GB · 4,652 downloads

TheDrummer/Artemis-31B-v1-GGUF

TheDrummer · from 11.10 GB · 4,530 downloads

mudler/GLM-4.7-Flash-APEX-GGUF

mudler · from 11.11 GB · 4,194 downloads

Jianqiao1/Qwen3.6-27B-MTP-MoQ-GGUF

Jianqiao1 · from 10.07 GB · 4,075 downloads

mudler/NVIDIA-Nemotron-3-Super-120B-A12B-APEX-GGUF

mudler · from 8.29 GB · 3,742 downloads

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

huihui-ai · from 10.15 GB · 3,481 downloads

mudler/Qwen3-Coder-30B-APEX-GGUF

mudler · from 11.29 GB · 3,465 downloads

mradermacher/Boulesis-v2.1-26B-A4B-GGUF

mradermacher · from 10.08 GB · 3,452 downloads

mudler/Qwopus3.6-35B-A3B-v1-APEX-MTP-GGUF

mudler · from 10.88 GB · 3,441 downloads

trjxter/Qwenseek-3.8-27B-CyberLite-GGUF

trjxter · from 10.12 GB · 3,365 downloads

DavidAU/Command-R-01-Ultra-NEO-DARK-HORROR-V1-V2-35B-IMATRIX-GGUF

DavidAU · from 10.34 GB · 3,330 downloads

vcruz305/Laguna-S-2.1-GGUF

vcruz305 · from 10.56 GB · 3,280 downloads

TaQuants/Tema_Q-X4-Thinking-TaQuants-GGUF

TaQuants · from 10.30 GB · 3,268 downloads

DAXZEIT/GRM-2.6-Plus-0628-MTP-reasoning-i1-GGUF

DAXZEIT · from 10.14 GB · 3,246 downloads

mradermacher/Qwen3-32B-Uncensored-GGUF

mradermacher · from 11.50 GB · 3,207 downloads

el4/Ornith-1.5-35B-A3B-ONYX-GGUF

el4 · from 11.23 GB · 3,040 downloads

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

pearsonkyle · from 8.89 GB · 2,982 downloads

andreaborio/Qwen3.6-35B-A3B-Hebrus-GGUF

andreaborio · from 11.45 GB · 2,938 downloads

trjxter/Qwimi-3.6-27B-Coder-MTP-GGUF

trjxter · from 11.27 GB · 2,900 downloads

NikiKrutan/GRM-2.6-Plus-0628-MTP-GGUF

NikiKrutan · from 8.30 GB · 2,868 downloads

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

pearsonkyle · from 8.89 GB · 2,651 downloads

mradermacher/Goetia-26B-A4B-v1.6-GGUF

mradermacher · from 10.08 GB · 2,577 downloads

Koshkasa/MuXodious_GLM-4.7-Flash-absolute-heresy-APEX-GGUF

Koshkasa · from 10.56 GB · 2,577 downloads

pearsonkyle/Qwopus3.6-27B-Coder-2bit-MTP-GGUF

pearsonkyle · from 8.89 GB · 2,558 downloads

mradermacher/Qwen3.6-27B-abliterated-v2-GGUF

mradermacher · from 9.98 GB · 2,394 downloads

AtomicChat/qwen3-coder-30b-a3b-GGUF

AtomicChat · from 10.49 GB · 2,383 downloads

mradermacher/Gemma-4-26B-A4B-StyleTune-QK-Heretic-GGUF

mradermacher · from 10.08 GB · 2,233 downloads

anik-jha/Qwen3.6-35B-A3B-coding-reap50-GGUF

anik-jha · from 10.59 GB · 2,190 downloads

bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF

bytkim · from 10.15 GB · 2,165 downloads

DavidAU/LFM2.5-24B-A2B-Turbo-Brilliance-50X-NEO-MAX-Imatrix-GGUF

DavidAU · from 9.80 GB · 2,161 downloads

mradermacher/GLM-4.7-Flash-abliteratex-GGUF

mradermacher · from 10.28 GB · 1,993 downloads

DavidAU/L3.1-MOE-6X8B-Dark-Reasoning-Dantes-Peak-HORROR-R1-Uncensored-36B-GGUF

DavidAU · from 9.08 GB · 1,970 downloads

SUPEROXIDES/HIVEMIND_PREVIEW_32B_-_GGUF

SUPEROXIDES · from 8.40 GB · 1,958 downloads

DavidAU/MN-DARKEST-UNIVERSE-29B-GGUF

DavidAU · from 10.25 GB · 1,946 downloads

mradermacher/Goetia-26B-A4B-v1.3-Absolute-Heretic-ARA-GGUF

mradermacher · from 9.86 GB · 1,946 downloads

LatitudeGames/Equinox-31B-GGUF

LatitudeGames · from 10.22 GB · 1,915 downloads

Ttimms/KAT-Coder-V2.5-Dev-REAP-50-GGUF

Ttimms · from 10.59 GB · 1,893 downloads

mradermacher/gemma-4-31B-it-abliterated-GGUF

mradermacher · from 11.10 GB · 1,889 downloads

mradermacher/G4-MeroMero-v2-31B-heretic-GGUF

mradermacher · from 11.10 GB · 1,859 downloads

ToastyPigeon/Other-Test-GGUFs

ToastyPigeon · from 8.87 GB · 1,854 downloads

mradermacher/Gemma-4-31B-Abliterated-Uncensored-GGUF

mradermacher · from 11.10 GB · 1,826 downloads

mradermacher/Ornith-1.5-27B-A3B-CoderX-GGUF

mradermacher · from 9.18 GB · 1,824 downloads

DavidAU/MN-Oblivion-26B-UNCENSORED-NEO-Imatrix-GGUF

DavidAU · from 9.15 GB · 1,784 downloads

mudler/LFM2-24B-A2B-APEX-GGUF

mudler · from 8.85 GB · 1,717 downloads

poisonxa/PXA-Fusion4-35B-GGUF

poisonxa · from 10.47 GB · 1,703 downloads

mradermacher/Boulesis-v2-26B-A4B-GGUF

mradermacher · from 10.08 GB · 1,673 downloads

mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF

mradermacher · from 8.28 GB · 1,670 downloads

mradermacher/Pantheon-Reasoning-26B-A4B-1.1-V2-GGUF

mradermacher · from 10.08 GB · 1,599 downloads

mradermacher/Goetia-26B-A4B-v1.5-GGUF

mradermacher · from 10.08 GB · 1,534 downloads

mradermacher/Whittle-Next-27B-A3B-GGUF

mradermacher · from 9.63 GB · 1,501 downloads

ToastyPigeon/Gemma-4-Test-GGUFs

ToastyPigeon · from 11.80 GB · 1,428 downloads

mradermacher/Qwen3.6-27B-A3B-CoderX-GGUF

mradermacher · from 9.18 GB · 1,386 downloads

Myric/Ornith-1.5-35B-A3B-APEX-GGUF

Myric · from 11.69 GB · 1,381 downloads

ozaa77/Cogito-0.9.1-15B-GGUF

ozaa77 · from 8.38 GB · 1,378 downloads

AtomicChat/qwen36-27b-GGUF

AtomicChat · from 9.98 GB · 1,371 downloads

exeterminal/Exe-Core-Dynamic-V1-GGUF

exeterminal · from 10.12 GB · 1,317 downloads

mradermacher/ZTC-Judge-27B-GGUF

mradermacher · from 10.12 GB · 1,316 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models