GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

marcsun13/tiny-Qwen3_5Moe-GGUF overview

marcsun13/tiny-Qwen3_5Moe-GGUF GGUF downloads for local AI inference with guIDE.

ggufendpoints_compatibleregion:usconversational

Runs locally from ~67.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
Author

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
tiny-moe-BF16.ggufGGUFBF16152.2 MBDownload
tiny-moe-Q4_K_M.ggufGGUFQ4_K_M67.1 MBDownload

Model Details

Model IDmarcsun13/tiny-Qwen3_5Moe-GGUF
Authormarcsun13
Pipeline
License
Base model
Last modified2026-08-29T11:36:29.000Z

Run marcsun13/tiny-Qwen3_5Moe-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models