Model Intelligence Sheet
Bosswinner/Qwen2.5-Coder-32B-Instruct-GGUF overview
Bosswinner/Qwen2.5-Coder-32B-Instruct-GGUF GGUF downloads for local AI inference with guIDE.
Runs locally from ~8.41 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
28 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen2.5-Coder-32B-Instruct-IQ2_M.gguf | GGUF | IQ2_M | 10.49 GB | Download |
| Qwen2.5-Coder-32B-Instruct-IQ2_S.gguf | GGUF | IQ2_S | 9.67 GB | Download |
| Qwen2.5-Coder-32B-Instruct-IQ2_XS.gguf | GGUF | IQ2_XS | 9.27 GB | Download |
| Qwen2.5-Coder-32B-Instruct-IQ2_XXS.gguf | GGUF | IQ2_XXS | 8.41 GB | Download |
| Qwen2.5-Coder-32B-Instruct-IQ3_M.gguf | GGUF | IQ3_M | 13.79 GB | Download |
| Qwen2.5-Coder-32B-Instruct-IQ3_XS.gguf | GGUF | IQ3_XS | 12.76 GB | Download |
| Qwen2.5-Coder-32B-Instruct-IQ3_XXS.gguf | GGUF | IQ3_XXS | 11.96 GB | Download |
| Qwen2.5-Coder-32B-Instruct-IQ4_NL.gguf | GGUF | IQ4_NL | 17.40 GB | Download |
| Qwen2.5-Coder-32B-Instruct-IQ4_XS.gguf | GGUF | IQ4_XS | 16.48 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q2_K.gguf | GGUF | Q2_K | 11.47 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q2_K_L.gguf | GGUF | Q2_K_L | 12.18 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q3_K_L.gguf | GGUF | Q3_K_L | 16.06 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q3_K_M.gguf | GGUF | Q3_K_M | 14.84 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q3_K_S.gguf | GGUF | Q3_K_S | 13.40 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q3_K_XL.gguf | GGUF | Q3_K_XL | 16.70 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q4_0.gguf | GGUF | Q4_0 | 17.43 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q4_0_4_4.gguf | GGUF | Q4_0_4_4 | 17.36 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q4_0_4_8.gguf | GGUF | Q4_0_4_8 | 17.36 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q4_0_8_8.gguf | GGUF | Q4_0_8_8 | 17.36 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q4_K_L.gguf | GGUF | Q4_K_L | 19.03 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q4_K_M.gguf | GGUF | Q4_K_M | 18.49 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q4_K_S.gguf | GGUF | Q4_K_S | 17.49 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q5_K_L.gguf | GGUF | Q5_K_L | 22.11 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q5_K_M.gguf | GGUF | Q5_K_M | 21.66 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q5_K_S.gguf | GGUF | Q5_K_S | 21.08 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q6_K.gguf | GGUF | Q6_K | 25.04 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q6_K_L.gguf | GGUF | Q6_K_L | 25.39 GB | Download |
| Qwen2.5-Coder-32B-Instruct-Q8_0.gguf | GGUF | Q8_0 | 32.43 GB | Download |
Model Details
| Model ID | Bosswinner/Qwen2.5-Coder-32B-Instruct-GGUF |
|---|---|
| Author | Bosswinner |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | Qwen/Qwen2.5-Coder-32B-Instruct |
| Last modified | 2026-07-27T04:07:53.000Z |
Run Bosswinner/Qwen2.5-Coder-32B-Instruct-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models