GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →

Models for 16 GB VRAM

Desktop-class 16 GB tier — higher quants and small multimodal models. Sorted by Hugging Face downloads. Smallest GGUF file size shown per model.

AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf
AbteeXAILab · from 15.78 GB · 854 downloads
AbteeXAILab/lumynax-infused-mistral-small-text-gguf
AbteeXAILab · from 13.35 GB · 752 downloads
mradermacher/Ornstein3.6-35B-A3B-GGUF
mradermacher · from 12.05 GB · 603 downloads
AbteeXAILab/lumynax-reasoning-deepseek-prover-v2-671b-gguf
AbteeXAILab · from 13.78 GB · 61 downloads
sci4ai/Qwen3.6-27B-Abliterated-IQ4_XS.gguf
sci4ai · from 14.47 GB · 0 downloads
EnReaper/Dolphin-Mistral-24B-Venice-Edition-Q4_K_M-GGUF
EnReaper · from 13.35 GB · 0 downloads
bandtor/gemma-4-26B-A4B-it-GGUF
bandtor · from 15.78 GB · 0 downloads
Brunobkr/OFFELLIA_IQ4_XS_diffusiongemma-26B-A4B-it.gguf
Brunobkr · from 13.11 GB · 0 downloads
Brunobkr/OFFELLIA_MXFP4_MOE_diffusiongemma-26B-A4B-it.gguf
Brunobkr · from 13.73 GB · 0 downloads
brodatech/supergemma4-26b-uncensored-gguf-v2
brodatech · from 15.64 GB · 0 downloads
unsloth/diffusiongemma-26B-A4B-it-GGUF
unsloth · from 15.65 GB · 0 downloads
AlexAtomic/diffusiongemma-26B-A4B-it-GGUF
AlexAtomic · from 15.65 GB · 0 downloads
FreedomAISVR/North-Mini-Code-1.0-MXFP4-GGUF
FreedomAISVR · from 15.87 GB · 0 downloads
ShyliaSafetensors/TritonModelStock-24B-Q4_K_M-GGUF
ShyliaSafetensors · from 13.35 GB · 0 downloads
FreedomAISVR/GLM-4.7-Flash-MXFP4-MOE-GGUF
FreedomAISVR · from 15.80 GB · 0 downloads
FreedomAISVR/GLM-4.7-Flash-NVFP4-GGUF
FreedomAISVR · from 15.79 GB · 0 downloads
Brunobkr/OFFELLIA_IQ4_NL_diffusiongemma-26B-A4B-it.gguf
Brunobkr · from 13.59 GB · 0 downloads
ShyliaSafetensors/TritonModelStock-V1-24B-Q4_K_M-GGUF
ShyliaSafetensors · from 13.35 GB · 0 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models