Models for 8 GB VRAM

Popular sweet spot for 8 GB GPUs — Q4/Q5 quants for daily local inference. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF

AnkitAI · from 4.68 GB · 564,224 downloads

FINAL-Bench/POCKET-35B-GGUF

FINAL-Bench · from 7.67 GB · 533,001 downloads

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF

AnkitAI · from 4.77 GB · 347,023 downloads

deepgrove/maple-preview-GGUF

deepgrove · from 4.64 GB · 314,604 downloads

LiquidAI/LFM2.5-8B-A1B-GGUF

LiquidAI · from 4.51 GB · 226,992 downloads

yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

yuxinlu1 · from 4.50 GB · 211,424 downloads

realrebelai/MiniMax-H3_GGUFs

realrebelai · from 7.91 GB · 87,870 downloads

realrebelai/KREA-2_GGUFs

realrebelai · from 5.14 GB · 81,263 downloads

MonsterMMORPG/Wan_GGUF

MonsterMMORPG · from 6.46 GB · 67,275 downloads

sudoingx/Ternary-Bonsai-2-27B-PTQ1_0-MTP-GGUF

sudoingx · from 5.87 GB · 48,451 downloads

0bserverx/Muse-Glimmer-30B-Heretic-Uncensored-GGUF

0bserverx · from 6.08 GB · 45,868 downloads

unsloth/LFM2.5-24B-A2B-GGUF

unsloth · from 6.96 GB · 44,125 downloads

IFM/K2-Horizon-7B-GGUF

IFM · from 5.21 GB · 35,214 downloads

BoldingBuilds/Ternary-Bonsai-2-27B-Abliterated-PTQ1_0-GGUF

BoldingBuilds · from 5.54 GB · 34,652 downloads

BoldingBuilds/Ternary-Bonsai-2-27B-Abliterated-PQ2_0-MTP-GGUF

BoldingBuilds · from 6.71 GB · 33,144 downloads

richardyoung/Qwen3-14B-abliterated-GGUF

richardyoung · from 6.41 GB · 24,183 downloads

mradermacher/Qwen3-14B-Uncensored-GGUF

mradermacher · from 5.36 GB · 22,007 downloads

bleysg/DeepSeek-V4-Flash-DSpark-drafter-GGUF

bleysg · from 6.46 GB · 19,903 downloads

nazeshinjite/DeepSeek-V4-Flash-0731-ds4-GGUF

nazeshinjite · from 7.83 GB · 17,203 downloads

DavidAU/LFM2.5-8B-A1B-Qwen3.8-Turbo-Brilliance-Power-X12-NEO-MAX-GGUF

DavidAU · from 4.27 GB · 16,463 downloads

satgeze/Hy3-1M-GGUF

satgeze · from 5.66 GB · 14,158 downloads

Jackrong/Qwen3.5-9B-DeepSeek-V4-Flash-MTP-GGUF

Jackrong · from 4.41 GB · 12,677 downloads

pottokao/Qwen-Image-2.1-PE-T2I-Heretic-GGUF

pottokao · from 5.49 GB · 11,668 downloads

ngquocvinh/AliceAI-T5-35B-A0.6B-GGUF

ngquocvinh · from 4.75 GB · 11,463 downloads

frontier-infra/jebadiah-9b-v2-GGUF

frontier-infra · from 5.38 GB · 11,199 downloads

CaryPalmer/Ternary-Bonsai-2-27B-262k-GGUF

CaryPalmer · from 5.96 GB · 10,776 downloads

AtomicChat/ornith-9b-GGUF

AtomicChat · from 4.84 GB · 10,443 downloads

ManniX-ITA/Qwen3.6-27B-A3B-CoderX-MTP-GGUF

ManniX-ITA · from 7.64 GB · 9,239 downloads

vcruz305/DeepSeek-V4.1-Flash-GGUF

vcruz305 · from 7.42 GB · 8,855 downloads

liodon-ai/Ornith-1.0-35B-GGUF-imatrix-GGUF

liodon-ai · from 6.97 GB · 8,587 downloads

mradermacher/DeepSeek-Coder-V2-Lite-Instruct-abliterated-GGUF

mradermacher · from 6.00 GB · 8,217 downloads

startlux-models/StartLux-Decision-v1-4B-Q8_0-GGUF

startlux-models · from 4.17 GB · 7,593 downloads

xPhoenix777/Flux-Klein-9b-GGUF-Conversions-NSFW

xPhoenix777 · from 6.04 GB · 7,146 downloads

richardyoung/Qwen3-8B-Abliterated-GGUF

richardyoung · from 4.68 GB · 7,083 downloads

freakyskittle/kimi-k2.7-code-GGUF

freakyskittle · from 5.91 GB · 6,714 downloads

TheDrummer/Rocinante-XL-16B-v1-GGUF

TheDrummer · from 5.77 GB · 6,454 downloads

startlux-models/StartLux-Decision-v1-9B-Q4_K_M-GGUF

startlux-models · from 5.24 GB · 6,281 downloads

Skttttt/Himeros-V2-27B-GGUF

Skttttt · from 4.35 GB · 5,812 downloads

richardyoung/Qwen2.5-7B-Instruct-abliterated-GGUF

richardyoung · from 4.36 GB · 5,330 downloads

llm-jp/llm-jp-4.1-8b-thinking-gguf

llm-jp · from 5.12 GB · 4,890 downloads

vcruz305/Ornith-1.0-35B-AEON-Ultimate-Uncensored-GGUF

vcruz305 · from 7.67 GB · 4,876 downloads

wepiqx/MiMo-V2.6-Distill-Qwen-9B-GGUF-MERNIK

wepiqx · from 4.41 GB · 4,328 downloads

mistrjirka/Gemma-4-12B-PXQ-GGUF

mistrjirka · from 4.11 GB · 4,135 downloads

AnkitAI/Mistral-Heretica-12B-GGUF

AnkitAI · from 6.96 GB · 4,119 downloads

Arki05/North-Mini-Code-1.0-GGUF

Arki05 · from 7.74 GB · 4,110 downloads

ToastyPigeon/Gemma4-Test-GGUFs

ToastyPigeon · from 5.75 GB · 4,108 downloads

mradermacher/gemma-4-E4B-it-erotica-GGUF

mradermacher · from 4.10 GB · 3,960 downloads

TheOneWhoWill/Coding-Monkey-Gemma-GGUF

TheOneWhoWill · from 6.87 GB · 3,951 downloads

bluevoid-pl/Muse-Glimmer-30B-pruned-GGUF

bluevoid-pl · from 6.99 GB · 3,714 downloads

AMAImedia/GLM-5.3-Flash-FP8-GGUF

AMAImedia · from 6.50 GB · 3,681 downloads

liodon-ai/Qwen2.5-14B-Instruct-imatrix-GGUF

liodon-ai · from 4.99 GB · 3,539 downloads

dev7a/DeepSeek-V4-Flash-0731-DSpark-Drafter-GGUF

dev7a · from 6.50 GB · 3,427 downloads

kingjones777/Qwen3.8-Flash-Next-ROCmFP4-FAST-GGUF

kingjones777 · from 4.71 GB · 3,375 downloads

LiquidAI/LFM2-8B-A1B-GGUF

LiquidAI · from 4.41 GB · 3,303 downloads

wepiqx/gemma-4-12B-it-SHQ6-GGUF

wepiqx · from 6.27 GB · 3,270 downloads

PeppX/Ornith-1.0-9B-Uncensored-GGUF

PeppX · from 5.24 GB · 3,149 downloads

Solstice-AI/DeepSeek-V4.1-Flash-GGUF

Solstice-AI · from 7.42 GB · 3,034 downloads

lmstudio-community/Laguna-S-2.1-GGUF

lmstudio-community · from 5.73 GB · 2,991 downloads

alessandrobologna/DeepSeek-V4-Flash-0731-DSpark-Drafter-GGUF

alessandrobologna · from 6.49 GB · 2,987 downloads

joeygambino/joyai-echo-gemma3-12b-encoder-Q8_0-gguf

joeygambino · from 7.31 GB · 2,951 downloads

wepiqx/gemma-4-12B-it-LWQ6-GGUF

wepiqx · from 6.27 GB · 2,799 downloads

mradermacher/Gemma-4-12B-OBLITERATED-GGUF

mradermacher · from 4.50 GB · 2,744 downloads

FINAL-Bench/Ourbox-35B-JGOS-GGUF

FINAL-Bench · from 7.67 GB · 2,741 downloads

Devlin-AI/Devlin-Alpha-22B-A3B-GGUF

Devlin-AI · from 7.95 GB · 2,716 downloads

spiritfather/MiniMax-M3-uncensored-GGUF

spiritfather · from 7.35 GB · 2,712 downloads

DavidAU/TieFighter-Holodeck-Holomax-Mythomax-F1-V1-COMPOS-20B-gguf

DavidAU · from 6.42 GB · 2,647 downloads

Joakimpalm-Zen/Xyntetik-Kvist-14B-GGUF

Joakimpalm-Zen · from 7.09 GB · 2,627 downloads

ManniX-ITA/gemma-4-A4B-98e-v5-coder-it-GGUF

ManniX-ITA · from 7.29 GB · 2,616 downloads

mistrjirka/Ornith-1.5-35B-A3B-PXQ-GGUF

mistrjirka · from 6.44 GB · 2,585 downloads

BigDannyPt/WAN-2.2-SmoothMix-GGUF

BigDannyPt · from 4.93 GB · 2,581 downloads

wepiqx/OxCoder-9B-MERNIK-GGUF

wepiqx · from 5.00 GB · 2,552 downloads

mradermacher/Gemma-4-12B-StyleTune-GGUF

mradermacher · from 4.81 GB · 2,468 downloads

webmp3/Sakura-humanizer-12B-GGUF

webmp3 · from 4.53 GB · 2,425 downloads

Em-80/Qwen3-coder-REAP-25B-A3B-Rust-GGUF

Em-80 · from 4.91 GB · 2,385 downloads

jakeatx/Qwen3.8-Perian-GGUF

jakeatx · from 4.86 GB · 2,376 downloads

Baekpica/Inkling-Small-GGUF

Baekpica · from 4.18 GB · 2,317 downloads

pragmaticcs/Triumvirate-Qwopus-MiMo-Ornith-9B-Coder-GGUF

pragmaticcs · from 5.05 GB · 2,309 downloads

mradermacher/Gemma-4-12B-it-AEON-Abliterated-K4-BF16-GGUF

mradermacher · from 4.50 GB · 2,243 downloads

wepiqx/Mellum2.1-12B-A2.5B-Thinking-MERNIK-GGUF

wepiqx · from 6.53 GB · 2,169 downloads

FadedRedStar/LFM2.5-8B-A1B-heretic-imatrix-GGUF

FadedRedStar · from 4.51 GB · 2,127 downloads

Adking98/MN-12B-Celeste-V1.9-GGUF

Adking98 · from 6.96 GB · 2,067 downloads

AMAImedia/Qwen3.5-9B-NeoHorse1-Heretic-NOESIS-BF16-GGUF

AMAImedia · from 5.24 GB · 2,039 downloads

mradermacher/Gemma-4-E4B-Abliterated-Uncensored-GGUF

mradermacher · from 4.08 GB · 2,028 downloads

Unkto/DeepSeek-V4-Flash-0731-DSpark-Drafter-IQ1M-IQ2XXS-GGUF

Unkto · from 4.46 GB · 2,015 downloads

mradermacher/Nidum-gemma-3-27B-it-Uncensored-i1-GGUF

mradermacher · from 5.83 GB · 2,010 downloads

Baekpica/Motif-3-Mixed-Quant-GGUF

Baekpica · from 4.16 GB · 1,998 downloads

dealignai/Bonsai-2-27B-1bit-CRACK-GGUF

dealignai · from 5.54 GB · 1,937 downloads

extraltodeus/Qwen3.5-9B-Nikusui-v1-gguf

extraltodeus · from 5.38 GB · 1,917 downloads

RemySkye/Qwen3.8-Flash-Next-REAM-60Pct-GGUF

RemySkye · from 6.42 GB · 1,907 downloads

mradermacher/Confucius4-T3PO-GGUF

mradermacher · from 5.37 GB · 1,797 downloads

shafire/Zero-Gemma4-E4B-OpenZero-GGUF

shafire · from 5.46 GB · 1,769 downloads

wepiqx/Ornith-1.5-9B-MTP-ASHQ1-GGUF

wepiqx · from 4.41 GB · 1,742 downloads

DavidAU/MN-GRAND-23.5B-Gutenberg-UNCENSORED-V2-GLM4.7-Thinking-NEO-Imatrix-GGUF

DavidAU · from 7.87 GB · 1,726 downloads

WhiskyAKM/Ling-3.0-Tiny-GGUF

WhiskyAKM · from 4.22 GB · 1,720 downloads

KikoCis/Ornith-1.0-9B-Ollama-fixed-GGUF

KikoCis · from 4.31 GB · 1,714 downloads

ManniX-ITA/gemma-4-A4B-98e-v3-it-GGUF

ManniX-ITA · from 6.86 GB · 1,657 downloads

pbhappliedsystems/qwen-2.5-7B-instruct-gguf-Q4-K-M

pbhappliedsystems · from 4.36 GB · 1,657 downloads

alessandrobologna/DeepSeek-V4-Flash-DSpark-Drafter-GGUF

alessandrobologna · from 6.49 GB · 1,617 downloads

singulared/DeepSeek-V4-Flash-0731-DSpark-GGUF

singulared · from 7.83 GB · 1,610 downloads

shafire/Zero-Qwen3-8B-OpenZero-GGUF

shafire · from 5.45 GB · 1,598 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models