Models for 8 GB VRAM

Popular sweet spot for 8 GB GPUs — Q4/Q5 quants for daily local inference. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

deepgrove/maple-preview-GGUF

deepgrove · from 4.64 GB · 314,604 downloads

AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF

AnkitAI · from 4.68 GB · 259,886 downloads

LiquidAI/LFM2.5-8B-A1B-GGUF

LiquidAI · from 4.51 GB · 226,992 downloads

yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

yuxinlu1 · from 4.50 GB · 211,424 downloads

realrebelai/MiniMax-H3_GGUFs

realrebelai · from 7.91 GB · 87,870 downloads

MonsterMMORPG/Wan_GGUF

MonsterMMORPG · from 6.46 GB · 82,430 downloads

0bserverx/Muse-Glimmer-30B-Heretic-Uncensored-GGUF

0bserverx · from 6.08 GB · 45,868 downloads

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF

AnkitAI · from 4.77 GB · 44,570 downloads

ToastyPigeon/Gemma4-Test-GGUFs

ToastyPigeon · from 5.75 GB · 44,275 downloads

bleysg/DeepSeek-V4-Flash-DSpark-drafter-GGUF

bleysg · from 6.46 GB · 19,903 downloads

nazeshinjite/DeepSeek-V4-Flash-0731-ds4-GGUF

nazeshinjite · from 7.83 GB · 17,203 downloads

satgeze/Hy3-1M-GGUF

satgeze · from 5.66 GB · 14,158 downloads

Jackrong/Qwen3.5-9B-DeepSeek-V4-Flash-MTP-GGUF

Jackrong · from 4.41 GB · 12,677 downloads

AtomicChat/ornith-9b-GGUF

AtomicChat · from 4.84 GB · 10,443 downloads

liodon-ai/Ornith-1.0-35B-GGUF-imatrix-GGUF

liodon-ai · from 6.97 GB · 8,587 downloads

FINAL-Bench/POCKET-35B-GGUF

FINAL-Bench · from 7.67 GB · 8,226 downloads

mradermacher/DeepSeek-Coder-V2-Lite-Instruct-abliterated-GGUF

mradermacher · from 6.00 GB · 8,217 downloads

xPhoenix777/Flux-Klein-9b-GGUF-Conversions-NSFW

xPhoenix777 · from 6.04 GB · 7,146 downloads

freakyskittle/kimi-k2.7-code-GGUF

freakyskittle · from 5.91 GB · 6,714 downloads

TheDrummer/Rocinante-XL-16B-v1-GGUF

TheDrummer · from 5.77 GB · 6,454 downloads

vcruz305/Ornith-1.0-35B-AEON-Ultimate-Uncensored-GGUF

vcruz305 · from 7.67 GB · 4,876 downloads

ManniX-ITA/Qwen3.6-27B-A3B-CoderX-MTP-GGUF

ManniX-ITA · from 7.64 GB · 4,707 downloads

LessThanThreeAI/Qwen3.8-27B-Humanlike-Chat-GGUF

LessThanThreeAI · from 6.96 GB · 4,534 downloads

Arki05/North-Mini-Code-1.0-GGUF

Arki05 · from 7.74 GB · 4,110 downloads

TheOneWhoWill/Coding-Monkey-Gemma-GGUF

TheOneWhoWill · from 6.87 GB · 3,951 downloads

smthem/comfy-org-gguf-int4

smthem · from 6.43 GB · 3,816 downloads

bluevoid-pl/Muse-Glimmer-30B-pruned-GGUF

bluevoid-pl · from 6.99 GB · 3,714 downloads

liodon-ai/Qwen2.5-14B-Instruct-imatrix-GGUF

liodon-ai · from 4.99 GB · 3,539 downloads

dev7a/DeepSeek-V4-Flash-0731-DSpark-Drafter-GGUF

dev7a · from 6.50 GB · 3,427 downloads

LiquidAI/LFM2-8B-A1B-GGUF

LiquidAI · from 4.41 GB · 3,303 downloads

wepiqx/gemma-4-12B-it-SHQ6-GGUF

wepiqx · from 6.27 GB · 3,270 downloads

PeppX/Ornith-1.0-9B-Uncensored-GGUF

PeppX · from 5.24 GB · 3,149 downloads

lmstudio-community/Laguna-S-2.1-GGUF

lmstudio-community · from 5.73 GB · 2,991 downloads

alessandrobologna/DeepSeek-V4-Flash-0731-DSpark-Drafter-GGUF

alessandrobologna · from 6.49 GB · 2,987 downloads

joeygambino/joyai-echo-gemma3-12b-encoder-Q8_0-gguf

joeygambino · from 7.31 GB · 2,951 downloads

wepiqx/gemma-4-12B-it-LWQ6-GGUF

wepiqx · from 6.27 GB · 2,799 downloads

mradermacher/Gemma-4-12B-OBLITERATED-GGUF

mradermacher · from 4.50 GB · 2,744 downloads

FINAL-Bench/Ourbox-35B-JGOS-GGUF

FINAL-Bench · from 7.67 GB · 2,741 downloads

Devlin-AI/Devlin-Alpha-22B-A3B-GGUF

Devlin-AI · from 7.95 GB · 2,716 downloads

DavidAU/TieFighter-Holodeck-Holomax-Mythomax-F1-V1-COMPOS-20B-gguf

DavidAU · from 6.42 GB · 2,647 downloads

ManniX-ITA/gemma-4-A4B-98e-v5-coder-it-GGUF

ManniX-ITA · from 7.29 GB · 2,616 downloads

Em-80/Qwen3-coder-REAP-25B-A3B-Rust-GGUF

Em-80 · from 4.91 GB · 2,385 downloads

mradermacher/Gemma-4-12B-it-AEON-Abliterated-K4-BF16-GGUF

mradermacher · from 4.50 GB · 2,243 downloads

FadedRedStar/LFM2.5-8B-A1B-heretic-imatrix-GGUF

FadedRedStar · from 4.51 GB · 2,127 downloads

Unkto/DeepSeek-V4-Flash-0731-DSpark-Drafter-IQ1M-IQ2XXS-GGUF

Unkto · from 4.46 GB · 2,015 downloads

mradermacher/Nidum-gemma-3-27B-it-Uncensored-i1-GGUF

mradermacher · from 5.83 GB · 2,010 downloads

Baekpica/Motif-3-Mixed-Quant-GGUF

Baekpica · from 4.16 GB · 1,998 downloads

extraltodeus/Qwen3.5-9B-Nikusui-v1-gguf

extraltodeus · from 5.38 GB · 1,917 downloads

RemySkye/Qwen3.8-Flash-Next-REAM-60Pct-GGUF

RemySkye · from 6.42 GB · 1,907 downloads

SixVolts/GLM-5.2-ewaste-edition-GGUF

SixVolts · from 5.76 GB · 1,813 downloads

shafire/Zero-Gemma4-E4B-OpenZero-GGUF

shafire · from 5.46 GB · 1,769 downloads

DavidAU/MN-GRAND-23.5B-Gutenberg-UNCENSORED-V2-GLM4.7-Thinking-NEO-Imatrix-GGUF

DavidAU · from 7.87 GB · 1,726 downloads

WhiskyAKM/Ling-3.0-Tiny-GGUF

WhiskyAKM · from 4.22 GB · 1,720 downloads

KikoCis/Ornith-1.0-9B-Ollama-fixed-GGUF

KikoCis · from 4.31 GB · 1,714 downloads

FINAL-Bench/POCKET-EN-GGUF

FINAL-Bench · from 4.96 GB · 1,691 downloads

ManniX-ITA/gemma-4-A4B-98e-v3-it-GGUF

ManniX-ITA · from 6.86 GB · 1,657 downloads

kingjones777/Qwen3.8-Flash-Next-ROCmFP4-FAST-GGUF

kingjones777 · from 4.71 GB · 1,649 downloads

alessandrobologna/DeepSeek-V4-Flash-DSpark-Drafter-GGUF

alessandrobologna · from 6.49 GB · 1,617 downloads

singulared/DeepSeek-V4-Flash-0731-DSpark-GGUF

singulared · from 7.83 GB · 1,610 downloads

shafire/Zero-Qwen3-8B-OpenZero-GGUF

shafire · from 5.45 GB · 1,598 downloads

cstr/VibeVoice-7B-GGUF

cstr · from 5.74 GB · 1,592 downloads

avar6/Motif-3-Beta-gguf

avar6 · from 7.27 GB · 1,530 downloads

ge525/Qwen3.8-9B-Distill-uncensored-heretic-Q4_K_M-GGUF

ge525 · from 5.38 GB · 1,457 downloads

liodon-ai/gemma-4-12B-it-imatrix-GGUF

liodon-ai · from 4.07 GB · 1,432 downloads

ManniX-ITA/gemma-4-A4B-109e-it-GGUF

ManniX-ITA · from 7.52 GB · 1,412 downloads

DavidAU/L3-Stheno-Maid-Blackroot-Grand-HORROR-16B-GGUF

DavidAU · from 5.88 GB · 1,372 downloads

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

wepiqx · from 6.34 GB · 1,356 downloads

majentik/gemma-4-E4B-RotorQuant-GGUF-IQ4_XS

majentik · from 4.74 GB · 1,348 downloads

TaQuants/Tema_Q-X4-8B-Thinking-TaQuants-GGUF

TaQuants · from 4.19 GB · 1,325 downloads

BigDannyPt/WAN-2.2-SmoothMix-GGUF

BigDannyPt · from 4.93 GB · 1,318 downloads

FINAL-Bench/POCKET-KR-GGUF

FINAL-Bench · from 4.75 GB · 1,294 downloads

mradermacher/STARK-WEB-12B-GGUF

mradermacher · from 4.50 GB · 1,273 downloads

xCloudinfo/xGemable-12B-coder-v2-fullft-GGUF

xCloudinfo · from 6.87 GB · 1,261 downloads

vcruz305/Hy3-GGUF

vcruz305 · from 4.08 GB · 1,236 downloads

FadedRedStar/Anubis-Mini-8B-v1-heretic-imatrix-GGUF

FadedRedStar · from 4.36 GB · 1,092 downloads

LuffyTheFox/Gemma-4-E4B-Uncensored-Genesis-GGUF

LuffyTheFox · from 4.97 GB · 1,087 downloads

Situus/STARK-WEB-12B-gguf

Situus · from 6.87 GB · 1,075 downloads

pinkelephantlimited/pinkelephant-llm-48b-s-gguf

pinkelephantlimited · from 7.81 GB · 1,056 downloads

Shlok0011/CulinaAI-Qwen2.5-7B-GGUF

Shlok0011 · from 4.36 GB · 1,055 downloads

Baekpica/dots3-note-prev-Mixed-Quant-GGUF

Baekpica · from 7.82 GB · 1,030 downloads

Arki05/BLS-Mini-Code-1.0-GGUF

Arki05 · from 7.74 GB · 1,015 downloads

mradermacher/Mordant-12B-Think-GGUF

mradermacher · from 4.46 GB · 995 downloads

liodon-ai/Grug-12B-imatrix-GGUF

liodon-ai · from 4.07 GB · 992 downloads

llm-jp/llm-jp-4-8b-thinking-gguf

llm-jp · from 4.94 GB · 985 downloads

aquaduck/Qwen3.8-27B-GGUF

aquaduck · from 7.10 GB · 922 downloads

wepiqx/Ornith-1.0-9B-ASHQ1-GGUF

wepiqx · from 4.75 GB · 913 downloads

FadedRedStar/Anubis-Mini-8B-v1-heretic-GGUF

FadedRedStar · from 4.58 GB · 910 downloads

Baekpica/Solar-Open2-250B-Mixed-Quant-GGUF

Baekpica · from 6.75 GB · 900 downloads

wepiqx/gemma-4-12B-OBLITERATED-LWQ7-GGUF

wepiqx · from 6.34 GB · 852 downloads

DavidAU/Reka-Flash-3-21B-Reasoning-Uncensored-MAX-NEO-Imatrix-GGUF

DavidAU · from 7.63 GB · 849 downloads

mradermacher/Qwen2.5-VL-32B-Instruct-i1-GGUF

mradermacher · from 6.77 GB · 846 downloads

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q8_0

majentik · from 4.63 GB · 817 downloads

mradermacher/Grok-3-reasoning-gemma3-12B-distilled-HF-GGUF

mradermacher · from 4.44 GB · 814 downloads

AnkitAI/Mistral-Heretica-12B-GGUF

AnkitAI · from 6.96 GB · 803 downloads

AbteeXAILab/lumynax-infused-gemma-e4b-text-gguf

AbteeXAILab · from 4.97 GB · 802 downloads

liodon-ai/gemma-4-12B-it-GGUF

liodon-ai · from 4.50 GB · 802 downloads

mradermacher/Neuron-V1-Distill-Qwen2-14B-GGUF

mradermacher · from 5.37 GB · 791 downloads

RemySkye/rwkv7-g1h-13.3b-GGUF

RemySkye · from 5.07 GB · 762 downloads

kingjones777/DeepSeek-V4-Flash-180B-ROCmFP4-STRIX_LEAN-GGUF

kingjones777 · from 6.89 GB · 739 downloads

realrebelai/Boogu-Image-Edit_GGUFs

realrebelai · from 6.37 GB · 724 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models