Models for 24 GB VRAM

Workstation GPUs with 24 GB — near-full quants and larger context. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

deepreinforce-ai/Ornith-1.0-35B-GGUF

deepreinforce-ai · from 19.71 GB · 1,838,371 downloads

CodeFault/Nvidia-Qwen3.6-27B-NVFP4-GGUF

CodeFault · from 16.63 GB · 27,958 downloads

poolside/Laguna-XS-2.1-GGUF

poolside · from 18.88 GB · 12,094 downloads

neko-legends/Qwen3.6-27B-NVFP4-MTP-GGUF

neko-legends · from 21.58 GB · 12,072 downloads

neko-legends/Qwen3.6-35B-A3B-NVFP4-MTP-GGUF

neko-legends · from 21.33 GB · 10,346 downloads

jashepp/Qwable-v1-35B-A3B-MXFP4_MOE_Hybrid-Imatrix-GGUF

jashepp · from 18.87 GB · 7,917 downloads

ApocalypseParty/G4-31B-configE-gguf

ApocalypseParty · from 23.47 GB · 7,695 downloads

oyildirim/CyberStrike-OffSec-35B-GGUF

oyildirim · from 20.22 GB · 5,791 downloads

williamliao/Qwen3.6-27B-Unsloth-NVFP4-Experimental-GGUF

williamliao · from 21.58 GB · 4,738 downloads

s-batman/Ornith-1.0-35B-NVFP4-MTP-GGUF

s-batman · from 18.91 GB · 4,548 downloads

mente-ai/uyu-2-28B-GGUF

mente-ai · from 21.56 GB · 4,291 downloads

AtomicChat/ornith-35b-GGUF

AtomicChat · from 19.71 GB · 3,852 downloads

CodeFault/Unsloth-Qwen3.6-27B-NVFP4-GGUF

CodeFault · from 18.71 GB · 3,485 downloads

plunderstruck/Nex-N2-mini-ROCmFP4-GGUF

plunderstruck · from 18.08 GB · 3,373 downloads

noctrex/Ornith-1.0-35B-MXFP4_MOE-GGUF

noctrex · from 19.01 GB · 3,333 downloads

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

deadbydawn101 · from 20.22 GB · 2,903 downloads

neko-legends/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4-GGUF-MTP

neko-legends · from 21.80 GB · 2,529 downloads

Nimbz/Gemma-4-Gembrain-31B-GGUF

Nimbz · from 16.54 GB · 2,408 downloads

EZForever/gemma-4-31B-it-qat-uncensored-heretic-UDmerge-GGUF

EZForever · from 16.10 GB · 2,360 downloads

williamliao/Qwen3.6-35B-A3B-NVFP4-GGUF

williamliao · from 21.10 GB · 2,267 downloads

hiratagoh/llm-jp-4-32b-a3b-thinking-GGUF

hiratagoh · from 16.37 GB · 2,186 downloads

Elsephire/Qwen3.6-35B-A3B-Nex-N2-mini-80-20-Beta-GGUF

Elsephire · from 18.97 GB · 1,665 downloads

TobiasLogic/Qwen2.5-Coder-32B-abliterated-GGUF

TobiasLogic · from 18.49 GB · 1,212 downloads

AtomicChat/Qwen3.6-35B-A3B-GGUF

AtomicChat · from 19.71 GB · 1,103 downloads

Frosty40/Ornith-1.0-35B-GGUF-NVFP4

Frosty40 · from 19.60 GB · 927 downloads

AbteeXAILab/lumynax-infused-qwen3-coder-30b-a3b-gguf

AbteeXAILab · from 17.28 GB · 834 downloads

singulared/Ornith-1.0-35B-MTP-GGUF

singulared · from 20.55 GB · 747 downloads

AbteeXAILab/lumynax-infused-qwen3-30b-a3b-gguf

AbteeXAILab · from 17.28 GB · 723 downloads

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-IQ4_XS

majentik · from 17.64 GB · 720 downloads

Preyazz/Ornith-1.0-35B-IQ4_XS-GGUF

Preyazz · from 17.44 GB · 665 downloads

Frosty40/SIQ-1-35B-B70-Turbo-GGUF

Frosty40 · from 23.03 GB · 645 downloads

linuxid10t/Laguna-XS.2-GGUF

linuxid10t · from 16.84 GB · 614 downloads

mradermacher/Qwen3-Coder-Next-REAM-GGUF

mradermacher · from 20.56 GB · 581 downloads

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q4_K_M

majentik · from 19.71 GB · 552 downloads

meshllm/GLM-4.7-Flash-MTP-GGUF

meshllm · from 17.61 GB · 537 downloads

ProCreations/grug-35b-gguf

ProCreations · from 19.71 GB · 523 downloads

kdqemre/Qwen3.6-27B-Omnimerge-v4-MTP-Q4_K_L-GGUF

kdqemre · from 16.19 GB · 517 downloads

mudler/Qwen3.6-35B-A3B-NVFP4-GGUF

mudler · from 22.21 GB · 457 downloads

localweights/Qwen3.6-35B-A3B-MTP-IMAT-IQ4_XS-Q8nextn-GGUF

localweights · from 17.87 GB · 451 downloads

UlukaDev/saturn-31b-Q4_K_M-GGUF

UlukaDev · from 17.40 GB · 443 downloads

AbteeXAILab/lumynax-reasoning-qwq-32b-gguf

AbteeXAILab · from 18.49 GB · 439 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-IQ4_XS

majentik · from 16.96 GB · 427 downloads

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q5_K_M

majentik · from 23.03 GB · 423 downloads

mudler/Qwen3.6-27B-NVFP4-GGUF

mudler · from 23.73 GB · 416 downloads

iamchum/wp-qwen3.6-35b-a3b-wp-judge-v4-gguf

iamchum · from 23.47 GB · 415 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q4_K_M

majentik · from 22.83 GB · 412 downloads

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q5_K_M

majentik · from 17.82 GB · 397 downloads

Elsephire/Qwen3.6-35B-A3B-vocabulary-trimming-GGUF

Elsephire · from 18.69 GB · 396 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-MXFP4_MOE

majentik · from 16.75 GB · 383 downloads

chartreuse-verte/gemma-4-31b-it-purple-euphemism-trial98-depurpled-GGUF

chartreuse-verte · from 17.40 GB · 369 downloads

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-GGUF

fraQtl · from 19.97 GB · 366 downloads

artichoke42/Qwen3.6-27B-KR-GGUF

artichoke42 · from 18.07 GB · 362 downloads

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q4_K_M

majentik · from 17.40 GB · 360 downloads

Elsephire/Qwen3.6-35B-A3B-Ornith-80-20-Beta-GGUF

Elsephire · from 18.97 GB · 348 downloads

andreaborio/Qwen3.6-35B-A3B-DS4-GGUF

andreaborio · from 19.38 GB · 343 downloads

andreaborio/Qwen3.6-35B-A3B-Hebrus-GGUF

andreaborio · from 19.38 GB · 343 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q3_K_M

majentik · from 18.49 GB · 334 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q2_K

majentik · from 16.68 GB · 332 downloads

CyberNative-AI/Qwen36-35B-A3B-CN-Q4KM-MTP-GGUF

CyberNative-AI · from 20.22 GB · 331 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-MXFP4_MOE

majentik · from 16.75 GB · 317 downloads

NexusProjectsAI/Nemotron-3-Nano-30B-A3B-Nexus-Agents-GGUF

NexusProjectsAI · from 22.83 GB · 314 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q4_K_M

majentik · from 22.83 GB · 311 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q3_K_M

majentik · from 18.49 GB · 308 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q2_K

majentik · from 16.68 GB · 303 downloads

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-IQ4_XS

majentik · from 16.96 GB · 299 downloads

AtomicChat/qwen-agentworld-35b-GGUF

AtomicChat · from 19.71 GB · 293 downloads

xCloudinfo/Qwen3.6-35B-A3B-Uncensored-xCloud-GGUF

xCloudinfo · from 19.71 GB · 292 downloads

Phil2Sat/Dark-Qwen3.6-35b-A3B-Apex-Compact-GGUF

Phil2Sat · from 16.11 GB · 284 downloads

majentik/gpt-oss-20b-RotorQuant-GGUF-Q8_0

majentik · from 20.73 GB · 283 downloads

DavidAU/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF

DavidAU · from 16.55 GB · 282 downloads

majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q5_K_M

majentik · from 17.82 GB · 281 downloads

artichoke42/Qwen3.6-27B-KR-MTP-GGUF

artichoke42 · from 18.35 GB · 271 downloads

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q5_K_M

majentik · from 20.35 GB · 271 downloads

majentik/gemma-4-31B-RotorQuant-GGUF-Q4_K_M

majentik · from 17.40 GB · 259 downloads

majentik/gemma-4-31B-RotorQuant-GGUF-Q5_K_M

majentik · from 20.35 GB · 255 downloads

ApocalypseParty/G4-26B-SFT-v2-3-gguf

ApocalypseParty · from 17.82 GB · 246 downloads

heterodoxin/qwen3.6-27b-apostate-gguf

heterodoxin · from 17.91 GB · 244 downloads

razank/Qwen2.5-VL-32B-Instruct-EM1-GGUF

razank · from 21.66 GB · 242 downloads

Elsephire/Qwen3.6-35B-A3B-Agents-A1-80-20-Beta-GGUF

Elsephire · from 18.97 GB · 231 downloads

williamliao/Gemma-4-26B-A4B-NVFP4-GGUF

williamliao · from 16.46 GB · 211 downloads

Frosty40/Qwen-AgentWorld-35B-A3B-GGUF

Frosty40 · from 19.71 GB · 210 downloads

xCloudinfo/NVIDIA-Nemotron-3-Nano-30B-A3B-GGUF

xCloudinfo · from 22.83 GB · 194 downloads

ApocalypseParty/G4-31B-DPO-Continuity-2ep-gguf

ApocalypseParty · from 17.40 GB · 184 downloads

majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-GGUF-Q4_K_M

majentik · from 22.83 GB · 183 downloads

majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-IQ4_XS

majentik · from 16.96 GB · 182 downloads

andreaborio/Qwen3.6-35B-A3B-DS4-ExpertMajor-v1-GGUF

andreaborio · from 19.38 GB · 178 downloads

ApocalypseParty/G4-26B-SFT-v2-3-chkpt445-gguf

ApocalypseParty · from 17.82 GB · 176 downloads

VaultLevel6/beaverai_gguf_backups

VaultLevel6 · from 23.33 GB · 168 downloads

Masol2222/atas-qwen3-coder-gguf

Masol2222 · from 17.28 GB · 157 downloads

majentik/Nemotron-Cascade-2-30B-A3B-TurboQuant-GGUF-Q4_K_M

majentik · from 22.83 GB · 155 downloads

Elsephire/Qwen3.6-35B-A3B-Holo-3.1-35B-A3B-80-20-Beta-GGUF

Elsephire · from 18.97 GB · 149 downloads

ApocalypseParty/G4-31B-DPO-Continuity-1-5ep-gguf

ApocalypseParty · from 20.35 GB · 149 downloads

majentik/Nemotron-Cascade-2-30B-A3B-RotorQuant-GGUF-Q4_K_M

majentik · from 22.83 GB · 149 downloads

majentik/Nemotron-Cascade-2-30B-A3B-TurboQuant-GGUF-IQ4_XS

majentik · from 16.96 GB · 147 downloads

FlyTheGoose/goose-aya-gguf

FlyTheGoose · from 21.47 GB · 141 downloads

majentik/Nemotron-Cascade-2-30B-A3B-TurboQuant-GGUF-Q3_K_M

majentik · from 18.49 GB · 140 downloads

majentik/Nemotron-Cascade-2-30B-A3B-RotorQuant-GGUF-IQ4_XS

majentik · from 16.96 GB · 139 downloads

majentik/Nemotron-Cascade-2-30B-A3B-RotorQuant-GGUF-Q3_K_M

majentik · from 18.49 GB · 137 downloads

ApocalypseParty/G4-31B-SFT-Diversity-gguf

ApocalypseParty · from 23.47 GB · 125 downloads

ApocalypseParty/G4-31B-SFT-Diversity-1-5ep-gguf

ApocalypseParty · from 23.47 GB · 122 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models