Models for 24 GB VRAM

Workstation GPUs with 24 GB — near-full quants and larger context. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

deepreinforce-ai/Ornith-1.0-35B-GGUF

deepreinforce-ai · from 19.71 GB · 1,838,371 downloads

llm-jp/llm-jp-4-33b-thinking-gguf

llm-jp · from 18.78 GB · 325,236 downloads

IFM/K2-Horizon-MoVA-36B-A4B-GGUF

IFM · from 20.83 GB · 37,182 downloads

CodeFault/Nvidia-Qwen3.6-27B-NVFP4-GGUF

CodeFault · from 16.63 GB · 27,958 downloads

mlasli/Qwen3.8-27B-Heretic-Uncensored-Q5_K_M-GGUF

mlasli · from 18.33 GB · 23,559 downloads

AnonimousA/Qwen3.8-Flash-Next-REAP-320-GGUF

AnonimousA · from 17.26 GB · 22,026 downloads

gbuzhf/Ornith-1.5-35B-A3B-Abliterated-CyberTiel-Calibrated-MTPv2-ICE-GGUF

gbuzhf · from 17.53 GB · 17,735 downloads

LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Final-GGUF

LuffyTheFox · from 16.24 GB · 14,878 downloads

poolside/Laguna-XS-2.1-GGUF

poolside · from 18.88 GB · 12,094 downloads

neko-legends/Qwen3.6-27B-NVFP4-MTP-GGUF

neko-legends · from 21.58 GB · 12,072 downloads

orcarouter/DeepSeek-V4-Flash-Vision-Uncensored-GGUF

orcarouter · from 21.31 GB · 11,610 downloads

rapatsky/Hy-Memory-30B-A3B-GGUF

rapatsky · from 16.98 GB · 11,405 downloads

llm-jp/llm-jp-4.1-32b-a3b-thinking-gguf

llm-jp · from 20.04 GB · 10,996 downloads

neko-legends/Qwen3.6-35B-A3B-NVFP4-MTP-GGUF

neko-legends · from 21.33 GB · 10,346 downloads

llm-jp/llm-jp-4.1-33b-thinking-gguf

llm-jp · from 19.01 GB · 8,292 downloads

jashepp/Qwable-v1-35B-A3B-MXFP4_MOE_Hybrid-Imatrix-GGUF

jashepp · from 18.87 GB · 7,917 downloads

pragmaticcs/Qwen-35B-A3B-SignOfFour-Coder-GGUF

pragmaticcs · from 20.00 GB · 6,707 downloads

Dargoth/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-Final-Experimental-GGUF

Dargoth · from 19.64 GB · 5,758 downloads

ggml-org/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF

ggml-org · from 20.88 GB · 5,331 downloads

gbuzhf/Ornith-1.5-35B-A3B-TIEL-Calibrated-MTPv2-ICE-GGUF

gbuzhf · from 17.53 GB · 4,837 downloads

thread13/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF-MTP

thread13 · from 18.35 GB · 4,755 downloads

williamliao/Qwen3.6-27B-Unsloth-NVFP4-Experimental-GGUF

williamliao · from 21.58 GB · 4,738 downloads

s-batman/Ornith-1.0-35B-NVFP4-MTP-GGUF

s-batman · from 18.91 GB · 4,548 downloads

wangzhang/Qwen3.6-35B-A3B-abliterated-GGUF

wangzhang · from 19.71 GB · 4,313 downloads

mente-ai/uyu-2-28B-GGUF

mente-ai · from 21.56 GB · 4,291 downloads

Baekpica/Qwen3.8-Flash-Next-Uncensored-Mixed-Quant-SSD-PLE-GGUF

Baekpica · from 18.06 GB · 4,257 downloads

AtomicChat/ornith-35b-GGUF

AtomicChat · from 19.71 GB · 3,852 downloads

mudler/MiniMax-M2.7-APEX-GGUF

mudler · from 17.06 GB · 3,534 downloads

CodeFault/Unsloth-Qwen3.6-27B-NVFP4-GGUF

CodeFault · from 18.71 GB · 3,485 downloads

plunderstruck/Nex-N2-mini-ROCmFP4-GGUF

plunderstruck · from 18.08 GB · 3,373 downloads

noctrex/Ornith-1.0-35B-MXFP4_MOE-GGUF

noctrex · from 19.01 GB · 3,333 downloads

spiritfather/Boulesis-26B-A4B-GGUF

spiritfather · from 16.03 GB · 3,295 downloads

wangzhang/gemma-4-31B-it-abliterated-GGUF

wangzhang · from 17.40 GB · 3,255 downloads

DarkKitsune/Qwen3.6-Qworus-35B-A3B-V1-APEX-GGUF

DarkKitsune · from 21.90 GB · 3,170 downloads

IFM/K2-Horizon-32B-GGUF

IFM · from 19.63 GB · 2,943 downloads

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

deadbydawn101 · from 20.22 GB · 2,903 downloads

Rabbit-Hole-Ai/Qwen3.8-27B-5090-goldilocks-GGUF

Rabbit-Hole-Ai · from 23.43 GB · 2,831 downloads

ggml-org/Nemotron-Nano-3-30B-A3B-GGUF

ggml-org · from 20.88 GB · 2,727 downloads

tngtech/Qwen3.6-27B-NVFP4-GGUF

tngtech · from 18.51 GB · 2,723 downloads

neko-legends/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4-GGUF-MTP

neko-legends · from 21.80 GB · 2,529 downloads

mudler/Nemotron-3-Nano-30B-A3B-APEX-GGUF

mudler · from 17.48 GB · 2,473 downloads

lmstudio-community/Laguna-XS-2.1-GGUF

lmstudio-community · from 18.88 GB · 2,453 downloads

Nimbz/Gemma-4-Gembrain-31B-GGUF

Nimbz · from 16.54 GB · 2,408 downloads

EZForever/gemma-4-31B-it-qat-uncensored-heretic-UDmerge-GGUF

EZForever · from 16.10 GB · 2,360 downloads

ggml-org/Laguna-XS-2.1-GGUF

ggml-org · from 18.22 GB · 2,337 downloads

jakeroxs/KAT-Coder-V2.5-Dev-35B-A3B-MTP-ABLITERATED-GGUF

jakeroxs · from 20.22 GB · 2,309 downloads

williamliao/Qwen3.6-35B-A3B-NVFP4-GGUF

williamliao · from 21.10 GB · 2,267 downloads

felippeburk/Qwen3.8-27B-NVFP4-MTP-GGUF

felippeburk · from 18.30 GB · 2,231 downloads

hiratagoh/llm-jp-4-32b-a3b-thinking-GGUF

hiratagoh · from 16.37 GB · 2,186 downloads

IsValorum/Qwen3.8-Flash-Coder-APEX-I-MiniPlus-V2.1-GGUF

IsValorum · from 20.27 GB · 1,957 downloads

mlasli/Qwen3.8-27B-Heretic-Uncensored-Q6_K-GGUF

mlasli · from 20.99 GB · 1,888 downloads

jdominick05/Qwen3.8-27B-24GB-262k-GGUF

jdominick05 · from 16.44 GB · 1,875 downloads

IsValorum/Qwen3.8-Flash-Coder-APEX-I-NanoPlus-GGUF

IsValorum · from 17.08 GB · 1,806 downloads

Elsephire/Qwen3.6-35B-A3B-Nex-N2-mini-80-20-Beta-GGUF

Elsephire · from 18.97 GB · 1,665 downloads

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-GGUF

fraQtl · from 19.97 GB · 1,614 downloads

a4lg/Qwen3.8-2.4T-A95B-MTP-ONLY-GGUF

a4lg · from 18.53 GB · 1,552 downloads

IFM/Jais-3-32B-GGUF

IFM · from 19.63 GB · 1,448 downloads

Achilles1089/fable-coder-35B-A3B-GGUF

Achilles1089 · from 20.22 GB · 1,331 downloads

pragmaticcs/SignOfFour-GGUF

pragmaticcs · from 19.71 GB · 1,233 downloads

TobiasLogic/Qwen2.5-Coder-32B-abliterated-GGUF

TobiasLogic · from 18.49 GB · 1,212 downloads

AI-conn/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated-i1-GGUF

AI-conn · from 17.28 GB · 1,210 downloads

mradermacher/ArliAI_GLM-4.5-Air-Derestricted_REAP50_Creative-GGUF

mradermacher · from 21.71 GB · 1,149 downloads

webmp3/Sakura-MicroQuality-Kolibri-1-GGUF

webmp3 · from 20.94 GB · 1,127 downloads

AtomicChat/Qwen3.6-35B-A3B-GGUF

AtomicChat · from 19.71 GB · 1,103 downloads

el4/Whittle-Qwen-3.8-35B-A3B-ONYX-GGUF

el4 · from 16.07 GB · 1,052 downloads

gbuzhf/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-MTP-GGUF

gbuzhf · from 17.99 GB · 1,017 downloads

Frosty40/Ornith-1.0-35B-GGUF-NVFP4

Frosty40 · from 19.60 GB · 927 downloads

startlux-models/StartLux-Decision-v1-9B-BF16-GGUF

startlux-models · from 16.69 GB · 907 downloads

alfodaniello/Qwen3-Next-80B-A3B-Instruct-RedLite-GGUF

alfodaniello · from 17.97 GB · 904 downloads

webmp3/Sakura-Qwen3.8-Flash-Next-Swift-3bit-352E-GGUF

webmp3 · from 23.87 GB · 866 downloads

pbhappliedsystems/qwen-2.5-32B-instruct-gguf-Q4-K-M

pbhappliedsystems · from 18.49 GB · 852 downloads

webmp3/Sakura-Qwen3.8-Flash-Next-Swift-2.5bit-352E-32GB-GGUF

webmp3 · from 18.77 GB · 846 downloads

llm-jp/llm-jp-4-32b-a3b-thinking-gguf

llm-jp · from 19.93 GB · 831 downloads

pbhappliedsystems/mistral-nemo-instruct-2407-gguf-F16

pbhappliedsystems · from 22.82 GB · 786 downloads

webmp3/Sakura-MicroQuality-Kolibri-1-365E-GGUF

webmp3 · from 19.99 GB · 773 downloads

singulared/Ornith-1.0-35B-MTP-GGUF

singulared · from 20.55 GB · 747 downloads

mradermacher/Huihui-Kimi-Linear-48B-A3B-Instruct-abliterated-GGUF

mradermacher · from 16.79 GB · 733 downloads

vulture3/G4-WanaMeroQueen-v3-31B-heretic-GGUF

vulture3 · from 17.40 GB · 724 downloads

pragmaticcs/Qwen3.8-KAT-AgentWorld-35B-A3B-Coder-GGUF

pragmaticcs · from 19.71 GB · 650 downloads

pragmaticcs/SignOfTheFour-GGUF

pragmaticcs · from 19.71 GB · 647 downloads

Frosty40/SIQ-1-35B-B70-Turbo-GGUF

Frosty40 · from 23.03 GB · 645 downloads

NjProVk/Ornith-1.5-35B-A3B-abliterated-GGUF

NjProVk · from 19.71 GB · 619 downloads

linuxid10t/Laguna-XS.2-GGUF

linuxid10t · from 16.84 GB · 614 downloads

mradermacher/dolphin-2.7-mixtral-8x7b-GGUF

mradermacher · from 16.12 GB · 602 downloads

mradermacher/Qwen3-Coder-Next-REAM-GGUF

mradermacher · from 20.56 GB · 581 downloads

90-008/Swift-1.5-Qwen3.8-Flash-Next-REAP-Pruned-GGUF

90-008 · from 17.10 GB · 568 downloads

UlukaDev/saturn-31b-Q4_K_M-GGUF

UlukaDev · from 17.40 GB · 557 downloads

meshllm/GLM-4.7-Flash-MTP-GGUF

meshllm · from 17.61 GB · 537 downloads

alfodaniello/Qwen3-Coder-Next-RedLite-GGUF

alfodaniello · from 17.99 GB · 528 downloads

ProCreations/grug-35b-gguf

ProCreations · from 19.71 GB · 523 downloads

kdqemre/Qwen3.6-27B-Omnimerge-v4-MTP-Q4_K_L-GGUF

kdqemre · from 16.19 GB · 517 downloads

Joakimpalm-Zen/Qwen3-Coder-30B-A3B-Instruct-keep120-Q4_K_M-GGUF

Joakimpalm-Zen · from 16.33 GB · 510 downloads

mradermacher/ClinicalCamel-70B-GGUF

mradermacher · from 23.71 GB · 471 downloads

mudler/Qwen3.6-35B-A3B-NVFP4-GGUF

mudler · from 22.21 GB · 457 downloads

lmcoleman/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-MagicQuant-GGUF

lmcoleman · from 17.60 GB · 457 downloads

localweights/Qwen3.6-35B-A3B-MTP-IMAT-IQ4_XS-Q8nextn-GGUF

localweights · from 17.87 GB · 451 downloads

poisonxa/Ornith-1.5-35B-A3B-PXQ4-GGUF

poisonxa · from 18.24 GB · 447 downloads

wacomctl672/Nemotron-3-Nano-Omni-30B-Abliterated-MM-GGUF

wacomctl672 · from 22.83 GB · 445 downloads

pertai/qwen38-et-27b-GGUF

pertai · from 20.89 GB · 427 downloads

mudler/Qwen3.6-27B-NVFP4-GGUF

mudler · from 23.73 GB · 416 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models