GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →

mudler author hub

Qwen3.6 35B A3B NVFP4 GGUF NVFP4 native Blackwell FP4 GGUF of Qwen3.6 35B A3B Mixture of Experts, ~3B active parameters per token . A single file, FP4 native quantization that runs on LocalAI's paged attention llama.cpp backend with strong decode throughput and a low memory foot…

Models
14
Downloads
7,950
mudler/face-detect-gguf
2,021 downloads ·
mudler/voice-detect-gguf
948 downloads ·
mudler/Qwen3.6-35B-A3B-NVFP4-GGUF
457 downloads · text-generation
mudler/Qwen3.6-27B-NVFP4-GGUF
416 downloads · text-generation
mudler/moss-transcribe.cpp-gguf
0 downloads · automatic-speech-recognition

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models