GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

mahmad-10xe/Qwen3.5-35B-A3B-GGUF-Quants overview

mahmad-10xe/Qwen3.5-35B-A3B-GGUF-Quants GGUF downloads for local AI inference with guIDE.

ggufendpoints_compatibleregion:usconversational

Runs locally from ~582.4 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
120
Likes
0
Pipeline

Repository Files & Downloads

12 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.5-35B-A3B-Q3_0-mmproj.ggufGGUFQ3_0582.4 MBDownload
Qwen3.5-35B-A3B-Q3_0.ggufGGUFQ3_015.62 GBDownload
Qwen3.5-35B-A3B-Q3_1_X-mmproj.ggufGGUFQ3_1_X582.4 MBDownload
Qwen3.5-35B-A3B-Q3_1_X.ggufGGUFQ3_1_X16.56 GBDownload
Qwen3.5-35B-A3B-Q3_X_CB8-mmproj.ggufGGUFQ3_X_CB8582.4 MBDownload
Qwen3.5-35B-A3B-Q3_X_CB8.ggufGGUFQ3_X_CB816.56 GBDownload
Qwen3.5-35B-A3B-w4a8-codebook-cb16-q8q4-mixed-exportrep.ggufGGUFQ8Q421.19 GBDownload
Qwen3.5-35B-A3B-w4a8-codebook-cb256-q8q4-mixed-exportrep.ggufGGUFQ8Q421.20 GBDownload
Qwen3.5-35B-A3B-w4a8-gptq-rot-q8q4-mixed-exportrep.ggufGGUFQ8Q420.33 GBDownload
Qwen3.5-35B-A3B-w4a8-q4_0-experts-mixed-rest-imatrix-scale-clip-routerw.ggufGGUFQ4_019.06 GBDownload
Qwen3.5-35B-A3B-w4a8-q4_0_q8_mixed.ggufGGUFQ4_0_Q8_MIXED20.26 GBDownload
Qwen3.5-35B-A3B-w4a8-q4_1x_q8_mixed.ggufGGUFQ4_1X_Q8_MIXED21.19 GBDownload

Model Details

Model IDmahmad-10xe/Qwen3.5-35B-A3B-GGUF-Quants
Authormahmad-10xe
Pipeline
License
Base model
Last modified2026-08-18T10:57:08.000Z

Run mahmad-10xe/Qwen3.5-35B-A3B-GGUF-Quants with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models