Models for 32 GB+ VRAM

Large local models and high-bit quants for 32 GB+ VRAM setups. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

windowsxp811203/Qwen3.8-Flash-Next-Abliterated-GGUF

windowsxp811203 · from 110.97 GB · 142,241 downloads

AngelSlim/Hy3-GGUF

AngelSlim · from 83.30 GB · 109,749 downloads

AngelSlim/Hy4-preview-GGUF

AngelSlim · from 213.66 GB · 82,512 downloads

autotrust/GLM-5.3-Flash-GGUF-DGX-Spark

autotrust · from 37.20 GB · 34,578 downloads

pentacoxian-dev/Qwen3.8-Flash-Next-IQ3E-Q8D-MTP-GGUF

pentacoxian-dev · from 80.02 GB · 23,118 downloads

sokann/GLM-5.2-GGUF-2.244bpw

sokann · from 196.76 GB · 21,142 downloads

spiritfather/cyberneurova-Qwen3.8-Flash-Next-i1-GGUF

spiritfather · from 74.92 GB · 17,559 downloads

mudler/Qwen3-Coder-Next-APEX-GGUF

mudler · from 29.22 GB · 12,243 downloads

kingjones777/Qwen3.8-Flash-Next-ROCmFP4-STRIX-GGUF

kingjones777 · from 113.47 GB · 9,926 downloads

twaggs88/DeepSeek-V4-Flash-REAP25-DSpark-ds4-GGUF

twaggs88 · from 86.14 GB · 9,750 downloads

startlux-models/StartLux-Decision-v1-27B-Q8_0-GGUF

startlux-models · from 26.63 GB · 8,909 downloads

llmfan46/MiniMax-M2.7-ultra-uncensored-heretic-GGUF

llmfan46 · from 41.15 GB · 8,789 downloads

audreyt/CyberNeurova-DeepSeek-V4-Flash-abliterated-GGUF

audreyt · from 80.76 GB · 7,951 downloads

autotrust/GLM-5.3-GGUF-DGX-Spark

autotrust · from 25.02 GB · 7,803 downloads

GCSA-AiLab/GLM-5.3-Flash-Uncensored-RCO-GSQ-GGUF

GCSA-AiLab · from 127.66 GB · 7,694 downloads

frz1/GLM-5.2-abliterated-GGUF

frz1 · from 32.81 GB · 6,409 downloads

giannisan/Hy3-ds4-gguf

giannisan · from 78.81 GB · 6,053 downloads

Cyronius/Qwen3.8-Flash-Next-131B-A6B-GGUF

Cyronius · from 60.34 GB · 5,971 downloads

neuralll/GLM-5.3-Flash-GSQ-RCO-3.0bit-Q4Kattn-GGUF

neuralll · from 105.78 GB · 5,602 downloads

mradermacher/Qwen3-Next-80B-A3B-Thinking-GRPO-Uncensored-GGUF

mradermacher · from 27.13 GB · 4,742 downloads

startlux-models/StartLux-Decision-v1-27B-BF16-GGUF

startlux-models · from 50.11 GB · 4,160 downloads

hellohazime/Kimi-K3-REAP-512GB-GGUF

hellohazime · from 38.06 GB · 3,705 downloads

icecubetr/GLM-5.2-REAM-GGUF

icecubetr · from 129.45 GB · 3,318 downloads

ji-farthing/Qwen3.8-Flash-Next-ik-llama-GGUF_v2

ji-farthing · from 36.31 GB · 3,284 downloads

freakyskittle/kimi-k2.75-code-GGUF

freakyskittle · from 188.74 GB · 3,178 downloads

heath0xFF/DeepSeek-V4-Flash-0731-REAP-GGUF

heath0xFF · from 60.93 GB · 3,008 downloads

shefowl/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-Hybrid-GGUF

shefowl · from 26.82 GB · 2,951 downloads

AMAImedia/Hy4-preview-BF16-GGUF

AMAImedia · from 213.66 GB · 2,876 downloads

jamesrogers/Qwen3.8-Flash-Next-MTP-MXFP4-GGUF

jamesrogers · from 118.13 GB · 2,738 downloads

KeinNiemand/DeepSeek-V4-Flash-0731-IK_GGUF

KeinNiemand · from 60.94 GB · 2,632 downloads

jcbtc/Laguna-S-2.1-Chadrock-ROCmFP4-StrixKVSpine-V4-GGUF

jcbtc · from 60.94 GB · 2,575 downloads

RemySkye/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-GGUF

RemySkye · from 29.30 GB · 2,404 downloads

mradermacher/gpt-oss-120b-abliterated-GGUF

mradermacher · from 59.03 GB · 2,307 downloads

mlasli/Qwen3.8-27B-Heretic-Uncensored-Q8_0-GGUF

mlasli · from 27.05 GB · 2,232 downloads

AMAImedia/DeepSeek-V4-Flash-Vision-Exp-FP8-GGUF

AMAImedia · from 141.14 GB · 2,181 downloads

Blackttc55/GLM-5.3-Flash-CYBERSECURITY-GGUF

Blackttc55 · from 94.26 GB · 2,159 downloads

SyndicateLabs/GLM-5.3-Flash-CYBERSECURITY-GGUF

SyndicateLabs · from 94.26 GB · 2,159 downloads

mudler/MiniMax-M2.5-APEX-GGUF

mudler · from 80.00 GB · 2,142 downloads

sokann/GLM-5.2-GGUF-1.630bpw

sokann · from 142.96 GB · 2,093 downloads

andreaborio/DeepSeek-V4-Flash-Hebrus-GGUF

andreaborio · from 80.76 GB · 2,054 downloads

sokann/DeepSeek-V4-Flash-GGUF

sokann · from 145.64 GB · 1,937 downloads

neopolita/Qwen3.8-Flash-Next-99B-A5B-Niwaki-3bit-gguf

neopolita · from 39.54 GB · 1,925 downloads

PaoAI/GLM-5.3-Flash-PaoAI-ROCmFP4-STRIX-BALANCED-GGUF

PaoAI · from 71.85 GB · 1,767 downloads

SUPEROXIDES/ZAYA1_PREVIEW_74B-A4B_-_GGUF

SUPEROXIDES · from 25.98 GB · 1,746 downloads

mudler/Huihui3.5-67B-A3B-APEX-GGUF

mudler · from 25.39 GB · 1,746 downloads

RobinsonLabs/Qwen3.5-REAP-262B-A17B-abliterated-GGUF

RobinsonLabs · from 64.50 GB · 1,656 downloads

autotrust/gpt-oss-120b-Fable-5-Distilled-GGUF

autotrust · from 75.15 GB · 1,636 downloads

mudler/Step-3.5-Flash-APEX-GGUF

mudler · from 71.26 GB · 1,550 downloads

plunderstruck/Qwen3-Coder-Next-ROCmFP4-GGUF

plunderstruck · from 39.85 GB · 1,503 downloads

SC117/Ling-3.0-flash-abliterated-APEX-GGUF

SC117 · from 56.25 GB · 1,496 downloads

mradermacher/Llama-3.3-70B-Instruct-heretic-GGUF

mradermacher · from 24.56 GB · 1,411 downloads

neopolita/Qwen3.8-Flash-Next-119B-A5B-Niwaki-v2.4-3bit-gguf

neopolita · from 47.50 GB · 1,380 downloads

neopolita/Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit-gguf

neopolita · from 40.84 GB · 1,346 downloads

UltimateIntent/HeatSeeker-284B-A13B-GGUF

UltimateIntent · from 60.10 GB · 1,272 downloads

Myric/Kimi-Linear-48B-A3B-Instruct-APEX-GGUF

Myric · from 28.23 GB · 1,258 downloads

kaitchup/MiniMax-M3-GGUF-MoQ

kaitchup · from 123.18 GB · 1,228 downloads

alessandrobologna/DeepSeek-V4-Pro-DSpark-Drafter-GGUF

alessandrobologna · from 24.79 GB · 1,224 downloads

ox-ox/DeepSeek-V4-Flash-0731-GGUF

ox-ox · from 90.89 GB · 1,156 downloads

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-GGUF

huihui-ai · from 80.84 GB · 1,112 downloads

sokann/GLM-5.2-GGUF-2.788bpw

sokann · from 244.49 GB · 1,048 downloads

ji-farthing/openPangu-2.0-Flash-ik-llama-GGUF

ji-farthing · from 53.46 GB · 1,010 downloads

Blockway/Agens-Volundr-32B-Preview-GGUF

Blockway · from 24.78 GB · 1,004 downloads

WhiskyAKM/Ling-3.0-flash-GGUF

WhiskyAKM · from 51.36 GB · 999 downloads

huihui-ai/Huihui-Laguna-S-2.1-abliterated-GGUF

huihui-ai · from 49.52 GB · 992 downloads

mradermacher/DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-GGUF

mradermacher · from 24.56 GB · 970 downloads

IsValorum/Qwen3.8-Flash-Coder-85GB-BF16-GGUF

IsValorum · from 79.44 GB · 957 downloads

Thaurock/Qwen3.5-122B-A10B-abliterated-GGUF

Thaurock · from 41.81 GB · 935 downloads

Frosty40/Leanstral-1.5-119B-A6B-GGUF-NVFP4

Frosty40 · from 62.52 GB · 924 downloads

datayoda/DeepSeek-V4-Flash-0731-DS4-Antirez-Coder-Halo-128K-MixQ-GGUF

datayoda · from 84.14 GB · 872 downloads

KeinNiemand/SuperDeepseek-V4-Flash-abliterated-IK_GGUF

KeinNiemand · from 60.94 GB · 854 downloads

sdwilsh/Ling-3.0-flash-GGUF

sdwilsh · from 26.44 GB · 838 downloads

hellohazime/Kimi-K3-REAP640-IQ1_S-GGUF

hellohazime · from 38.06 GB · 836 downloads

mradermacher/Golddiamondgold-Paperbliteration-L33-70b-GGUF

mradermacher · from 24.56 GB · 819 downloads

mradermacher/Huihui-Qwen3-Next-80B-A3B-Thinking-abliterated-GGUF

mradermacher · from 27.13 GB · 814 downloads

bloomer010/Ling-3.0-flash-REAP384-97B-A5B-GGUF

bloomer010 · from 32.85 GB · 808 downloads

mradermacher/Alkahest-V9.2-Unhinged-RP-Alpha-V1-Llama-3.3-70B-GGUF

mradermacher · from 24.56 GB · 803 downloads

puwaer/Qwen3-Next-80B-A3B-Thinking-GRPO-Uncensored-gguf

puwaer · from 27.13 GB · 795 downloads

PaoAI/Qwen3.8-Flash-Next-PaoAI-STRIX-BALANCED-2-GGUF

PaoAI · from 72.90 GB · 776 downloads

ggml-org/Laguna-S-2.1-GGUF

ggml-org · from 63.01 GB · 771 downloads

aj9o9/GLM-5.3-Flash-GGUF

aj9o9 · from 30.36 GB · 760 downloads

ddh0/GLM-5.3-Flash-GGUF

ddh0 · from 130.15 GB · 746 downloads

Myric/Llama-4-Scout-17B-16E-Instruct-APEX-GGUF

Myric · from 35.22 GB · 707 downloads

Thaurock/Llama-3.3-70B-Instruct-abliterated-GGUF

Thaurock · from 24.56 GB · 693 downloads

avar6/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-gguf

avar6 · from 31.71 GB · 683 downloads

Wladastic/DeepSeek-V4-Flash-0731-Ombro-v1-GGUF

Wladastic · from 75.78 GB · 683 downloads

bloomer010/Ling-3.0-flash-REAP288-73B-A5B-GGUF

bloomer010 · from 24.99 GB · 680 downloads

mradermacher/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-GGUF

mradermacher · from 42.66 GB · 673 downloads

mradermacher/Ling-3.0-flash-Fin-GGUF

mradermacher · from 43.34 GB · 664 downloads

bloomer010/Ling-3.0-flash-REAP320-81B-A5B-GGUF

bloomer010 · from 27.61 GB · 640 downloads

webmp3/Sakura-MiMo-V2.6-Flash-MOPD-P160-GGUF

webmp3 · from 53.79 GB · 637 downloads

mradermacher/Neuron-46x4B-Instruct-GGUF

mradermacher · from 42.37 GB · 636 downloads

Amarillys/Qwen3.8-Flash-Next-Uncensored-ik-llama-v4-lite-iq3-kt-GGUF

Amarillys · from 25.03 GB · 596 downloads

steampunque/GLM-4.5-Air-MP-GGUF

steampunque · from 59.25 GB · 596 downloads

ggml-org/gemma-4-26B-A4B-GGUF

ggml-org · from 25.02 GB · 589 downloads

rickytzai/Qwen3.6-35B-A3B-TW-v4a-GGUF

rickytzai · from 34.37 GB · 586 downloads

andreaborio/GLM-5.2-Hebrus-GGUF

andreaborio · from 244.14 GB · 559 downloads

Thaurock/Qwen2.5-72B-Instruct-abliterated-GGUF

Thaurock · from 27.76 GB · 554 downloads

mradermacher/L3.3-MS-Nevoria-70b-GGUF

mradermacher · from 24.56 GB · 554 downloads

neopolita/Qwen3.8-Flash-Next-113B-A5B-Niwaki-3bit-gguf

neopolita · from 45.71 GB · 544 downloads

ggml-org/gemma-4-31B-GGUF

ggml-org · from 30.39 GB · 532 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models