Models for 4 GB VRAM

Compact GGUF quantizations suitable for 4 GB VRAM laptops and mini PCs. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

unsloth/Qwen3.8-27B-GGUF

unsloth · from 13.0 MB · 5,126,652 downloads

DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF

DavidAU · from 884.6 MB · 2,852,257 downloads

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

huihui-ai · from 888.0 MB · 2,305,654 downloads

antirez/deepseek-v4-gguf

antirez · from 889.6 MB · 2,082,306 downloads

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

empero-ai · from 875.6 MB · 2,006,265 downloads

JonathanColetti/Qwen3.8-27B-Uncensored-GGUF

JonathanColetti · from 884.6 MB · 1,666,948 downloads

unsloth/gemma-4-26B-A4B-it-GGUF

unsloth · from 440.4 MB · 1,513,752 downloads

prism-ml/Bonsai-27B-gguf

prism-ml · from 600.1 MB · 1,218,815 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V10-GGUF

LuffyTheFox · from 857.6 MB · 1,071,426 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V9-GGUF

LuffyTheFox · from 857.6 MB · 1,038,728 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V12-GGUF

LuffyTheFox · from 857.6 MB · 965,464 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V13-GGUF

LuffyTheFox · from 857.6 MB · 923,388 downloads

DavidAU/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF

DavidAU · from 875.6 MB · 823,072 downloads

lmstudio-community/gemma-4-E4B-it-GGUF

lmstudio-community · from 945.6 MB · 750,134 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V7-GGUF

LuffyTheFox · from 857.6 MB · 740,390 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V8-GGUF

LuffyTheFox · from 857.6 MB · 740,390 downloads

unsloth/gemma-4-12b-it-GGUF

unsloth · from 167.0 MB · 654,915 downloads

prism-ml/Ternary-Bonsai-27B-gguf

prism-ml · from 600.1 MB · 607,071 downloads

unsloth/gemma-4-26B-A4B-it-qat-GGUF

unsloth · from 240.3 MB · 557,133 downloads

LiquidAI/LFM2.5-2.6B-GGUF

LiquidAI · from 1.48 GB · 554,506 downloads

lmstudio-community/gemma-4-12B-it-QAT-GGUF

lmstudio-community · from 167.0 MB · 522,297 downloads

unsloth/gemma-4-E4B-it-GGUF

unsloth · from 94.1 MB · 518,226 downloads

unsloth/gemma-4-31B-it-GGUF

unsloth · from 490.8 MB · 502,588 downloads

unsloth/gemma-4-E2B-it-GGUF

unsloth · from 93.3 MB · 454,680 downloads

unsloth/Qwen3.8-Flash-Next-GGUF

unsloth · from 10.4 MB · 431,339 downloads

Serveurperso/MiniMax-Music3-GGUF

Serveurperso · from 96.0 MB · 423,738 downloads

DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF

DavidAU · from 884.6 MB · 401,881 downloads

meta-models/Muse-Glimmer-30B-GGUF

meta-models · from 1.30 GB · 395,175 downloads

ornith-ai/Ornith-1.5-35B-A3B-GGUF

ornith-ai · from 861.0 MB · 369,478 downloads

ornith-ai/Ornith-1.5-9B-GGUF

ornith-ai · from 879.0 MB · 359,078 downloads

0bserverx/Qwen3.8-27B-Heretic-Abliterated-Uncensored-GGUF

0bserverx · from 600.1 MB · 326,638 downloads

Jackrong/Qwopus3.6-27B-Coder-Compat-MTP-GGUF

Jackrong · from 888.0 MB · 322,097 downloads

Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF

Jackrong · from 888.0 MB · 304,114 downloads

tencent/Hy-MT2-1.8B-GGUF

tencent · from 1.06 GB · 303,155 downloads

orcarouter/Qwen3.8-27B-Uncensored-GGUF

orcarouter · from 888.0 MB · 299,670 downloads

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

LiquidAI · from 663.5 MB · 294,148 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V6-GGUF

LuffyTheFox · from 857.6 MB · 287,745 downloads

unsloth/gemma-4-31B-it-qat-GGUF

unsloth · from 267.0 MB · 287,625 downloads

peculiar-ragdoll/Tiel-Coder-35B-A3B-GGUF

peculiar-ragdoll · from 183.3 MB · 282,068 downloads

peculiar-ragdoll/Tiel-Coder-35B-A3B-GGUF-MTP

peculiar-ragdoll · from 861.0 MB · 263,911 downloads

DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP-GGUF

DavidAU · from 884.6 MB · 258,896 downloads

ggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF

ggml-org · from 1.08 GB · 251,614 downloads

lmstudio-community/gemma-4-26B-A4B-it-QAT-GGUF

lmstudio-community · from 1.11 GB · 239,170 downloads

AnkitAI/Parable-Granite-4.1-3B-Claude-Fable-5-GGUF

AnkitAI · from 1.96 GB · 237,077 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Wasserstein-GGUF

LuffyTheFox · from 857.6 MB · 232,242 downloads

ggml-org/gemma-4-26B-A4B-it-GGUF

ggml-org · from 240.3 MB · 224,111 downloads

lmstudio-community/gemma-4-31B-it-QAT-GGUF

lmstudio-community · from 1.12 GB · 220,551 downloads

unsloth/Kimi-K3-GGUF

unsloth · from 6.6 MB · 218,732 downloads

Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Jackrong · from 888.0 MB · 207,166 downloads

Blackfrost-AI/Qwen3.8-27B-ABLITERATED-GGUF

Blackfrost-AI · from 600.1 MB · 203,299 downloads

Jackrong/Qwen3.5-9B-DeepSeek-V4-Flash-GGUF

Jackrong · from 879.0 MB · 201,613 downloads

lmstudio-community/gemma-4-12B-it-GGUF

lmstudio-community · from 167.0 MB · 198,850 downloads

mudler/gemma-4-26B-A4B-it-APEX-GGUF

mudler · from 1.11 GB · 184,373 downloads

mudler/Qwen3.6-35B-A3B-APEX-GGUF

mudler · from 861.0 MB · 182,394 downloads

LiquidAI/LFM2.5-230M-GGUF

LiquidAI · from 142.2 MB · 180,184 downloads

DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-MTP-GGUF

DavidAU · from 884.6 MB · 176,969 downloads

handy-computer/whisper-large-v3-turbo-gguf

handy-computer · from 511.2 MB · 168,080 downloads

Jackrong/Qwopus3.6-35B-A3B-Coder-MTP-GGUF

Jackrong · from 1.66 GB · 159,871 downloads

batiai/Qwen3.6-27B-GGUF

batiai · from 589.7 MB · 151,824 downloads

AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF

AnkitAI · from 2.33 GB · 146,204 downloads

unsloth/DeepSeek-V4-Flash-0731-GGUF

unsloth · from 5.0 MB · 145,105 downloads

DavidAU/Qwen3.6-27B-Heretic-Uncensored-FINETUNE-NEO-CODE-Di-IMatrix-MAX-GGUF

DavidAU · from 884.6 MB · 143,966 downloads

Jackrong/Qwopus3.6-27B-v2-MTP-GGUF

Jackrong · from 888.0 MB · 142,373 downloads

orcarouter/Qwen3.8-Flash-Next-Uncensored-GGUF

orcarouter · from 513.7 MB · 140,965 downloads

owao/Nanbeige4.2-3B-GGUF

owao · from 1.64 GB · 137,030 downloads

llmfan46/gemma-4-31B-it-uncensored-heretic-GGUF

llmfan46 · from 1.12 GB · 127,757 downloads

rahul7star/gemma-gguf

rahul7star · from 116.4 MB · 127,703 downloads

poolside/Laguna-S-2.1-GGUF

poolside · from 2.08 GB · 126,641 downloads

mudler/Qwen3.5-35B-A3B-APEX-GGUF

mudler · from 857.6 MB · 126,106 downloads

lmstudio-community/gemma-4-E2B-it-GGUF

lmstudio-community · from 941.1 MB · 123,717 downloads

zerodigest/Qwen3.8-27B-Uncensored-YMQ-MTP-GGUF

zerodigest · from 477.2 MB · 114,421 downloads

bartowski/google_gemma-4-E2B-it-GGUF

bartowski · from 2.7 MB · 113,484 downloads

Jackrong/Qwopus3.8-27B-Flash-GGUF

Jackrong · from 1.72 GB · 113,295 downloads

Jackrong/Qwopus3.5-9B-Coder-MTP-GGUF

Jackrong · from 879.0 MB · 111,943 downloads

Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Jackrong · from 879.0 MB · 111,070 downloads

esatapedico/Qwen3.8-27B-NVFP4-MTP-GGUF

esatapedico · from 888.0 MB · 109,643 downloads

togatogah/jinen-v2-small.gguf

togatogah · from 68.8 MB · 104,834 downloads

unsloth/Laguna-S-2.1-GGUF

unsloth · from 3.5 MB · 102,684 downloads

lmstudio-community/gemma-4-31B-it-GGUF

lmstudio-community · from 1.12 GB · 100,189 downloads

google/gemma-4-26B-A4B-it-qat-q4_0-gguf

google · from 1.11 GB · 98,318 downloads

unsloth/GLM-5.3-Flash-GGUF

unsloth · from 9.0 MB · 90,621 downloads

togatogah/jinen-v1-small.gguf

togatogah · from 84.4 MB · 87,788 downloads

google/gemma-4-31B-it-qat-q4_0-gguf

google · from 1.12 GB · 87,187 downloads

ibm-granite/granite-4.2-8b-GGUF

ibm-granite · from 3.18 GB · 86,597 downloads

puwaer/DeepSeek-V4-Flash-0731-reap-150b-gguf

puwaer · from 240.2 MB · 85,993 downloads

ibm-granite/granite-4.2-3b-GGUF

ibm-granite · from 1.36 GB · 83,892 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V5-GGUF

LuffyTheFox · from 857.6 MB · 83,658 downloads

LiquidAI/LFM2.5-350M-GGUF

LiquidAI · from 209.2 MB · 83,014 downloads

Jackrong/Qwopus3.6-35B-A3B-v1-GGUF

Jackrong · from 861.0 MB · 82,859 downloads

mradermacher/gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-i1-GGUF

mradermacher · from 13.1 MB · 78,131 downloads

ornith-ai/Ornith-1.5-397B-GGUF

ornith-ai · from 879.0 MB · 78,085 downloads

DavidAU/Qwen3.6-40B-Fable-Fusion-6-Core-Deckard-Eleanor-Heretic-Uncensored-NM-DAU-NEO-MAX-MTP-GGUF

DavidAU · from 884.6 MB · 75,629 downloads

AtomicChat/Qwen3.8-27B-GGUF

AtomicChat · from 884.6 MB · 72,562 downloads

DavidAU/Qwen3.6-40B-Grand-Intelligence-Fable-Fusion-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF

DavidAU · from 884.6 MB · 72,091 downloads

bartowski/google_gemma-4-26B-A4B-it-GGUF

bartowski · from 54.3 MB · 71,208 downloads

bloomer010/Ling-3.0-tiny-GGUF

bloomer010 · from 42.0 MB · 70,254 downloads

SC117/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-APEX-GGUF

SC117 · from 857.6 MB · 69,127 downloads

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

GnLOLot · from 656.2 MB · 68,714 downloads

scragnog/MiniMax-Music3-GGUF

scragnog · from 5.1 MB · 68,608 downloads

bartowski/gemma-4-12B-it-GGUF

bartowski · from 7.1 MB · 67,374 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models