Models for 32 GB+ VRAM

Large local models and high-bit quants for 32 GB+ VRAM setups. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

AngelSlim/Hy3-GGUF

AngelSlim · from 83.30 GB · 109,749 downloads

AngelSlim/Hy4-preview-GGUF

AngelSlim · from 213.66 GB · 82,512 downloads

sokann/GLM-5.2-GGUF-2.244bpw

sokann · from 196.76 GB · 21,142 downloads

antirez/glm-5.2-gguf

antirez · from 196.58 GB · 13,883 downloads

mudler/Qwen3-Coder-Next-APEX-GGUF

mudler · from 29.22 GB · 12,243 downloads

twaggs88/DeepSeek-V4-Flash-REAP25-DSpark-ds4-GGUF

twaggs88 · from 86.14 GB · 9,750 downloads

llmfan46/MiniMax-M2.7-ultra-uncensored-heretic-GGUF

llmfan46 · from 41.15 GB · 8,789 downloads

audreyt/CyberNeurova-DeepSeek-V4-Flash-abliterated-GGUF

audreyt · from 80.76 GB · 7,951 downloads

Cyronius/Qwen3.8-Flash-Next-131B-A6B-GGUF

Cyronius · from 60.34 GB · 7,641 downloads

frz1/GLM-5.2-abliterated-GGUF

frz1 · from 32.81 GB · 6,409 downloads

giannisan/Hy3-ds4-gguf

giannisan · from 78.81 GB · 6,053 downloads

kingjones777/Qwen3.8-Flash-Next-ROCmFP4-STRIX-GGUF

kingjones777 · from 113.47 GB · 3,944 downloads

RobinsonLabs/Qwen3.5-REAP-212B-A17B-abliterated-GGUF

RobinsonLabs · from 52.41 GB · 3,884 downloads

hellohazime/Kimi-K3-REAP-512GB-GGUF

hellohazime · from 38.06 GB · 3,705 downloads

icecubetr/GLM-5.2-REAM-GGUF

icecubetr · from 129.45 GB · 3,318 downloads

freakyskittle/kimi-k2.75-code-GGUF

freakyskittle · from 188.74 GB · 3,178 downloads

heath0xFF/DeepSeek-V4-Flash-0731-REAP-GGUF

heath0xFF · from 60.93 GB · 3,008 downloads

jamesrogers/Qwen3.8-Flash-Next-MTP-MXFP4-GGUF

jamesrogers · from 118.13 GB · 2,738 downloads

jcbtc/Laguna-S-2.1-Chadrock-ROCmFP4-StrixKVSpine-V4-GGUF

jcbtc · from 60.94 GB · 2,575 downloads

RemySkye/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-GGUF

RemySkye · from 29.30 GB · 2,404 downloads

mlasli/Qwen3.8-27B-Heretic-Uncensored-Q8_0-GGUF

mlasli · from 27.05 GB · 2,232 downloads

mudler/MiniMax-M2.5-APEX-GGUF

mudler · from 80.00 GB · 2,142 downloads

sokann/GLM-5.2-GGUF-1.630bpw

sokann · from 142.96 GB · 2,093 downloads

andreaborio/DeepSeek-V4-Flash-Hebrus-GGUF

andreaborio · from 80.76 GB · 2,054 downloads

sokann/DeepSeek-V4-Flash-GGUF

sokann · from 145.64 GB · 1,937 downloads

AMAImedia/Hy4-preview-BF16-GGUF

AMAImedia · from 213.66 GB · 1,923 downloads

SUPEROXIDES/ZAYA1_PREVIEW_74B-A4B_-_GGUF

SUPEROXIDES · from 25.98 GB · 1,746 downloads

mudler/Huihui3.5-67B-A3B-APEX-GGUF

mudler · from 25.39 GB · 1,746 downloads

autotrust/gpt-oss-120b-Fable-5-Distilled-GGUF

autotrust · from 75.15 GB · 1,636 downloads

mudler/Step-3.5-Flash-APEX-GGUF

mudler · from 71.26 GB · 1,550 downloads

SC117/Ling-3.0-flash-abliterated-APEX-GGUF

SC117 · from 56.25 GB · 1,537 downloads

plunderstruck/Qwen3-Coder-Next-ROCmFP4-GGUF

plunderstruck · from 39.85 GB · 1,503 downloads

mradermacher/Qwen3-Next-80B-A3B-Thinking-GRPO-Uncensored-GGUF

mradermacher · from 27.13 GB · 1,414 downloads

UltimateIntent/HeatSeeker-284B-A13B-GGUF

UltimateIntent · from 60.10 GB · 1,272 downloads

Myric/Kimi-Linear-48B-A3B-Instruct-APEX-GGUF

Myric · from 28.23 GB · 1,258 downloads

IFM/K2-Horizon-MoVA-36B-A4B-GGUF

IFM · from 69.78 GB · 1,258 downloads

kaitchup/MiniMax-M3-GGUF-MoQ

kaitchup · from 123.18 GB · 1,228 downloads

alessandrobologna/DeepSeek-V4-Pro-DSpark-Drafter-GGUF

alessandrobologna · from 24.79 GB · 1,224 downloads

ox-ox/DeepSeek-V4-Flash-0731-GGUF

ox-ox · from 90.89 GB · 1,156 downloads

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-GGUF

huihui-ai · from 80.84 GB · 1,112 downloads

sokann/GLM-5.2-GGUF-2.788bpw

sokann · from 244.49 GB · 1,048 downloads

ji-farthing/openPangu-2.0-Flash-ik-llama-GGUF

ji-farthing · from 53.46 GB · 1,010 downloads

WhiskyAKM/Ling-3.0-flash-GGUF

WhiskyAKM · from 51.36 GB · 999 downloads

huihui-ai/Huihui-Laguna-S-2.1-abliterated-GGUF

huihui-ai · from 49.52 GB · 992 downloads

Frosty40/Leanstral-1.5-119B-A6B-GGUF-NVFP4

Frosty40 · from 62.52 GB · 924 downloads

hellohazime/Kimi-K3-REAP640-IQ1_S-GGUF

hellohazime · from 38.06 GB · 836 downloads

bloomer010/Ling-3.0-flash-REAP384-97B-A5B-GGUF

bloomer010 · from 32.85 GB · 808 downloads

puwaer/Qwen3-Next-80B-A3B-Thinking-GRPO-Uncensored-gguf

puwaer · from 27.13 GB · 795 downloads

aj9o9/GLM-5.3-Flash-GGUF

aj9o9 · from 30.36 GB · 760 downloads

Myric/Llama-4-Scout-17B-16E-Instruct-APEX-GGUF

Myric · from 35.22 GB · 707 downloads

avar6/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-gguf

avar6 · from 31.71 GB · 705 downloads

Wladastic/DeepSeek-V4-Flash-0731-Ombro-v1-GGUF

Wladastic · from 75.78 GB · 683 downloads

bloomer010/Ling-3.0-flash-REAP288-73B-A5B-GGUF

bloomer010 · from 24.99 GB · 680 downloads

ggml-org/Laguna-S-2.1-GGUF

ggml-org · from 63.01 GB · 677 downloads

bloomer010/Ling-3.0-flash-REAP320-81B-A5B-GGUF

bloomer010 · from 27.61 GB · 640 downloads

mradermacher/Neuron-46x4B-Instruct-GGUF

mradermacher · from 42.37 GB · 636 downloads

rickytzai/Qwen3.6-35B-A3B-TW-v4a-GGUF

rickytzai · from 34.37 GB · 586 downloads

andreaborio/GLM-5.2-Hebrus-GGUF

andreaborio · from 244.14 GB · 559 downloads

avar6/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16-gguf

avar6 · from 89.14 GB · 559 downloads

sokann/DeepSeek-V4-Flash-0731-GGUF

sokann · from 94.09 GB · 514 downloads

Myric/Nemotron-Labs-3-Puzzle-75B-A9B-APEX-GGUF

Myric · from 28.88 GB · 504 downloads

jabbatheduck/Laguna-S-2.1-Uncensored-GGUF

jabbatheduck · from 48.01 GB · 501 downloads

cloudyu/DeepSeek-V4-Flash-4Expert-GGUF

cloudyu · from 153.17 GB · 485 downloads

kingjones777/Laguna-S-2.1-ROCmFP4-STRIX_LEAN-GGUF

kingjones777 · from 58.34 GB · 461 downloads

mradermacher/Hypernova-60B-2605-GGUF

mradermacher · from 28.72 GB · 455 downloads

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q8_0

majentik · from 25.02 GB · 432 downloads

26B-Suite/Goetia-26B-A4B-v1.5-Prototypes-Q8_0-GGUF

26B-Suite · from 25.02 GB · 420 downloads

mradermacher/Golddiamondgold-Paperbliteration-L33-70b-GGUF

mradermacher · from 24.56 GB · 420 downloads

mradermacher/XORTRON-NXTXPRTXXL-GGUF

mradermacher · from 43.39 GB · 418 downloads

kingjones777/Leanstral-1.5-119B-A6B-ROCmFP4-STRIX_LEAN-GGUF

kingjones777 · from 59.01 GB · 418 downloads

hellohazime/Qwen3.8-2.4T-A95B-REAP-256GB-GGUF

hellohazime · from 229.31 GB · 407 downloads

cloudyu/hy3-gguf

cloudyu · from 161.84 GB · 403 downloads

mradermacher/Qwen3.5-122B-A10B-abliterated-v1-GGUF

mradermacher · from 41.52 GB · 398 downloads

0xSero/DeepSeek-V4-Flash-Spark-GGUF

0xSero · from 76.73 GB · 389 downloads

PaoAI/GLM-5.3-Flash-PaoAI-ROCmFP4-STRIX-BALANCED-GGUF

PaoAI · from 71.85 GB · 389 downloads

mradermacher/Omega-Sapphira-L3.3-70B-v1.3-GGUF

mradermacher · from 24.56 GB · 383 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q8_0

majentik · from 31.28 GB · 380 downloads

mradermacher/Qwen3.5-122B-A10B-abliterix-GGUF

mradermacher · from 41.81 GB · 372 downloads

avar6/Step-3.5-Flash-Base-gguf

avar6 · from 195.03 GB · 367 downloads

kingjones777/Laguna-S-2.1-Q4_0_ROCMFP4_STRIX_LEAN-GGUF

kingjones777 · from 58.34 GB · 366 downloads

majentik/gemma-4-31B-RotorQuant-GGUF-Q8_0

majentik · from 30.39 GB · 362 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q5_K_M

majentik · from 24.25 GB · 345 downloads

ghecko78/Laguna-S-2.1-NVFP4-GGUF

ghecko78 · from 67.03 GB · 339 downloads

majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q4_K_M

majentik · from 80.14 GB · 334 downloads

greghavens/fabletron-nemotron-3-super-120b-GGUF

greghavens · from 80.14 GB · 321 downloads

whm0627/Qwen3.8-Flash-Next-177B-A3B-fits64GB-PLElast-GGUF

whm0627 · from 67.56 GB · 319 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q5_K_M

majentik · from 24.25 GB · 311 downloads

skt/A.X-K2-GGUF

skt · from 344.99 GB · 308 downloads

dev7a/DeepSeek-V4-Pro-DSpark-Drafter-GGUF

dev7a · from 24.79 GB · 308 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q8_0

majentik · from 31.28 GB · 306 downloads

exalandru/GPT-OSS-Coder-GGUF

exalandru · from 60.88 GB · 305 downloads

majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q8_0

majentik · from 25.02 GB · 292 downloads

WaveCut/DeepSeek-V4-Flash-0731-REAM160-180B-DS4-GGUF

WaveCut · from 53.37 GB · 287 downloads

hizrianraz/Laguna-S-2.1-GGUF

hizrianraz · from 89.44 GB · 286 downloads

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q8_0

majentik · from 30.39 GB · 285 downloads

zenlm/zen-5-mini-gguf

zenlm · from 128.84 GB · 282 downloads

hellohazime/Kimi-K3-REAP640ja-IQ1_S-GGUF

hellohazime · from 411.07 GB · 276 downloads

mradermacher/Ling-3.0-flash-base-GGUF

mradermacher · from 43.34 GB · 274 downloads

jakeatx/slimder-qwen38-reap384-depth40-mb4-5-GGUF

jakeatx · from 60.06 GB · 270 downloads

ryant0000/DeepSeek-V4-Pro-0813-gguf

ryant0000 · from 57.31 GB · 257 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models