Models for 4 GB VRAM

Compact GGUF quantizations suitable for 4 GB VRAM laptops and mini PCs. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

antirez/deepseek-v4-gguf

antirez · from 3.55 GB · 4,128,813 downloads

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

empero-ai · from 875.6 MB · 2,006,265 downloads

unsloth/gemma-4-26B-A4B-it-GGUF

unsloth · from 440.4 MB · 1,513,752 downloads

prism-ml/Bonsai-27B-gguf

prism-ml · from 600.1 MB · 1,218,815 downloads

lmstudio-community/gemma-4-E4B-it-GGUF

lmstudio-community · from 945.6 MB · 750,134 downloads

unsloth/gemma-4-12b-it-GGUF

unsloth · from 167.0 MB · 654,915 downloads

unsloth/gemma-4-26B-A4B-it-qat-GGUF

unsloth · from 240.3 MB · 557,133 downloads

lmstudio-community/gemma-4-12B-it-QAT-GGUF

lmstudio-community · from 167.0 MB · 522,297 downloads

unsloth/gemma-4-E4B-it-GGUF

unsloth · from 94.1 MB · 518,226 downloads

unsloth/gemma-4-31B-it-GGUF

unsloth · from 490.8 MB · 502,588 downloads

DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF

DavidAU · from 884.6 MB · 483,845 downloads

unsloth/gemma-4-E2B-it-GGUF

unsloth · from 93.3 MB · 454,680 downloads

bottlecapai/ThinkingCap-Qwen3.6-27B-GGUF

bottlecapai · from 888.0 MB · 362,867 downloads

DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF

DavidAU · from 884.6 MB · 347,264 downloads

Jackrong/Qwopus3.6-27B-Coder-Compat-MTP-GGUF

Jackrong · from 888.0 MB · 322,097 downloads

Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF

Jackrong · from 888.0 MB · 304,114 downloads

prism-ml/Ternary-Bonsai-27B-gguf

prism-ml · from 600.1 MB · 301,893 downloads

unsloth/gemma-4-31B-it-qat-GGUF

unsloth · from 267.0 MB · 287,625 downloads

lmstudio-community/gemma-4-26B-A4B-it-QAT-GGUF

lmstudio-community · from 1.11 GB · 239,170 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Wasserstein-GGUF

LuffyTheFox · from 857.6 MB · 232,242 downloads

ggml-org/gemma-4-26B-A4B-it-GGUF

ggml-org · from 240.3 MB · 224,111 downloads

lmstudio-community/gemma-4-31B-it-QAT-GGUF

lmstudio-community · from 1.12 GB · 220,551 downloads

Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Jackrong · from 888.0 MB · 207,166 downloads

Jackrong/Qwen3.5-9B-DeepSeek-V4-Flash-GGUF

Jackrong · from 879.0 MB · 201,613 downloads

lmstudio-community/gemma-4-12B-it-GGUF

lmstudio-community · from 167.0 MB · 198,850 downloads

rahul7star/gemma-gguf

rahul7star · from 116.4 MB · 170,005 downloads

handy-computer/whisper-large-v3-turbo-gguf

handy-computer · from 511.2 MB · 168,080 downloads

Jackrong/Qwopus3.6-35B-A3B-Coder-MTP-GGUF

Jackrong · from 1.66 GB · 159,871 downloads

DavidAU/Qwen3.6-27B-Heretic-Uncensored-FINETUNE-NEO-CODE-Di-IMatrix-MAX-GGUF

DavidAU · from 884.6 MB · 143,966 downloads

Jackrong/Qwopus3.6-27B-v2-MTP-GGUF

Jackrong · from 888.0 MB · 142,373 downloads

llmfan46/gemma-4-31B-it-uncensored-heretic-GGUF

llmfan46 · from 1.12 GB · 127,757 downloads

lmstudio-community/gemma-4-E2B-it-GGUF

lmstudio-community · from 941.1 MB · 123,717 downloads

Jackrong/Qwopus3.5-9B-Coder-MTP-GGUF

Jackrong · from 879.0 MB · 111,943 downloads

Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Jackrong · from 879.0 MB · 111,070 downloads

lmstudio-community/gemma-4-31B-it-GGUF

lmstudio-community · from 1.12 GB · 100,189 downloads

google/gemma-4-26B-A4B-it-qat-q4_0-gguf

google · from 1.11 GB · 98,318 downloads

google/gemma-4-31B-it-qat-q4_0-gguf

google · from 1.12 GB · 87,187 downloads

Jackrong/Qwopus3.6-35B-A3B-v1-GGUF

Jackrong · from 861.0 MB · 82,859 downloads

LiquidAI/LFM2.5-VL-1.6B-GGUF

LiquidAI · from 556.1 MB · 69,726 downloads

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

GnLOLot · from 656.2 MB · 68,714 downloads

mradermacher/gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-i1-GGUF

mradermacher · from 13.1 MB · 63,748 downloads

poolside/Laguna-S-2.1-GGUF

poolside · from 2.08 GB · 62,092 downloads

Jackrong/Qwopus3.5-9B-Coder-GGUF

Jackrong · from 879.0 MB · 61,978 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-V2-APEX-MTP-GGUF

LuffyTheFox · from 857.6 MB · 61,868 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V5-GGUF

LuffyTheFox · from 857.6 MB · 60,643 downloads

Jackrong/Qwopus3.5-9B-v3-GGUF

Jackrong · from 879.0 MB · 58,490 downloads

w-ahmad/LFM2.5-8B-A1B-GGUF-MoQ

w-ahmad · from 2.71 GB · 57,464 downloads

unsloth/GLM-5.2-GGUF

unsloth · from 9.0 MB · 55,820 downloads

lmstudio-community/gemma-4-26B-A4B-it-GGUF

lmstudio-community · from 1.11 GB · 53,076 downloads

Jackrong/Qwopus3.6-27B-v1-preview-GGUF

Jackrong · from 888.0 MB · 51,441 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-GGUF

LuffyTheFox · from 857.6 MB · 47,720 downloads

w-ahmad/Qwen3.5-9B-GGUF-MoQ

w-ahmad · from 4.9 MB · 46,780 downloads

InternScience/Agents-A1-Q4_K_M-GGUF

InternScience · from 857.6 MB · 46,122 downloads

YanissAmz/Hy3-295B-A21B-GGUF

YanissAmz · from 573.7 MB · 44,746 downloads

SC117/gemma-4-12B-it-heretic-QAT-GGUF

SC117 · from 167.0 MB · 43,455 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-GGUF

LuffyTheFox · from 857.6 MB · 40,159 downloads

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1-GGUF

Jackrong · from 879.0 MB · 39,672 downloads

SC117/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-APEX-GGUF

SC117 · from 857.6 MB · 39,567 downloads

Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-GGUF

Jackrong · from 888.0 MB · 39,340 downloads

Jackrong/Qwopus3.6-27B-Coder-GGUF

Jackrong · from 888.0 MB · 37,161 downloads

LordNeel/Agents-A1-GGUF

LordNeel · from 861.0 MB · 36,578 downloads

nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-GGUF

nerkyor · from 1.88 GB · 35,451 downloads

sahilchachra/Unlimited-OCR-GGUF

sahilchachra · from 774.3 MB · 35,408 downloads

unsloth/Kimi-K2.7-Code-GGUF

unsloth · from 6.6 MB · 33,667 downloads

yuxinlu1/gemma-4-12B-it-Claude-4.6-4.8-Opus-GGUF

yuxinlu1 · from 443.6 MB · 32,904 downloads

Jackrong/Qwopus3.6-35B-A3B-v1-MTP-GGUF

Jackrong · from 861.0 MB · 31,619 downloads

mradermacher/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-GGUF

mradermacher · from 600.1 MB · 31,281 downloads

unsloth/Laguna-S-2.1-GGUF

unsloth · from 3.5 MB · 28,542 downloads

mradermacher/Gemma-4-12B-OBLITERATED-i1-GGUF

mradermacher · from 7.1 MB · 25,663 downloads

Jackrong/Qwen3.5-2B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Jackrong · from 640.3 MB · 25,575 downloads

protoLabsAI/Ornith-1.0-9B-MTP-GGUF

protoLabsAI · from 2.26 GB · 24,464 downloads

Jackrong/Qwopus3.6-27B-v2-GGUF

Jackrong · from 888.0 MB · 24,117 downloads

realrebelai/KREA-2_GGUFs

realrebelai · from 2.78 GB · 23,962 downloads

pearsonkyle/gemma4-31b-imatrix-mtp-GGUF

pearsonkyle · from 341.2 MB · 23,294 downloads

mradermacher/Qwen3.5-9B-Fable-5-v1-i1-GGUF

mradermacher · from 4.9 MB · 23,044 downloads

unsloth/DeepSeek-V4-Flash-GGUF

unsloth · from 5.0 MB · 22,953 downloads

ManniX-ITA/gemma-4-A4B-98e-v7-coder-it-GGUF

ManniX-ITA · from 1.11 GB · 22,341 downloads

satgeze/Ornith-1.0-35B-1M-GGUF

satgeze · from 857.6 MB · 22,294 downloads

mradermacher/Huihui-gemma-4-12B-it-abliterated-i1-GGUF

mradermacher · from 7.1 MB · 20,914 downloads

jashepp/Equinox-31B-i1-MXFP4-GGUF

jashepp · from 13.1 MB · 20,549 downloads

ggml-org/Qwen3-0.6B-GGUF

ggml-org · from 409.1 MB · 20,152 downloads

mradermacher/Gemma-4-31B-StyleTune-i1-GGUF

mradermacher · from 13.1 MB · 19,444 downloads

WithinUsAI/Opus4.7-GODs.Ghost.Codex-4B.GGuF

WithinUsAI · from 2.52 GB · 18,252 downloads

SC117/Qwen3.5-122B-A10B-Uncensored-APEX-Compact-GGUF

SC117 · from 866.6 MB · 17,623 downloads

King3Djbl/nexus-medical-GGUF

King3Djbl · from 416.3 MB · 16,369 downloads

mradermacher/Qwen35B-Agent-R2-Abliterated-i1-GGUF

mradermacher · from 183.3 MB · 16,042 downloads

BennyDaBall/Z-Image-Engineer-V6-GGUF

BennyDaBall · from 1.93 GB · 16,037 downloads

mradermacher/Qwen3.6-34B-80L-Fable-5-Heretic-i1-GGUF

mradermacher · from 16.3 MB · 15,186 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V3-GGUF

LuffyTheFox · from 857.6 MB · 15,148 downloads

Jackrong/Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-v2-GGUF

Jackrong · from 644.3 MB · 15,144 downloads

SC117/Ornith-1.0-35B-MTP-APEX-GGUF

SC117 · from 857.6 MB · 14,713 downloads

llmfan46/gemma-4-12B-coder-fable5-composer2.5-v1-uncensored-heretic-GGUF

llmfan46 · from 116.4 MB · 14,698 downloads

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

ewinregirgojr · from 656.2 MB · 14,617 downloads

utautako/Qwen3.6-27B-NVIDIA-NVFP4-MTP-GGUF

utautako · from 888.0 MB · 13,960 downloads

LuffyTheFox/Qwen3-Uncensored-TextEncoders-Klein-Z-Image-Anima-GGUF

LuffyTheFox · from 1.12 GB · 13,942 downloads

huihui-ai/Huihui-GLM-5.2-abliterated-GGUF

huihui-ai · from 9.0 MB · 13,901 downloads

DuoNeural/Gemma4-12B-IT-Abliterated-GGUF

DuoNeural · from 116.4 MB · 13,651 downloads

ggml-org/gemma-4-31B-it-GGUF

ggml-org · from 267.0 MB · 13,133 downloads

mradermacher/Gemma-4-26B-A4B-StyleTune-V2-i1-GGUF

mradermacher · from 54.3 MB · 13,027 downloads

jashepp/Ornith-1.0-35B-A3B-MXFP4_MOE_Hybrid-Imatrix-GGUF

jashepp · from 183.3 MB · 12,103 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models