GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

RemySkye/KAT-Coder-V2.5-Dev-GGUF overview

KAT Coder V2.5 Dev GGUF GGUF files for Kwaipilot/KAT Coder V2.5 Dev https://huggingface.co/Kwaipilot/KAT Coder V2.5 Dev , including a BF16 reference GGUF and m…

llama.cppggufquantizedtext-generationcodecodingagentic-codingmixture-of-expertsmoeqwen3.5qwen3.6base_model:Kwaipilot/KAT-Coder-V2.5-Devbase_model:quantized:Kwaipilot/KAT-Coder-V2.5-Devlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~12.05 GB disk (16 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

16 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
KAT-Coder-V2.5-Dev-BF16.ggufGGUFBF1664.61 GBDownload
KAT-Coder-V2.5-Dev-IQ4_XS.ggufGGUFIQ4_XS17.64 GBDownload
KAT-Coder-V2.5-Dev-Q2_K.ggufGGUFQ2_K12.05 GBDownload
KAT-Coder-V2.5-Dev-Q3_K_L.ggufGGUFQ3_K_L16.87 GBDownload
KAT-Coder-V2.5-Dev-Q3_K_M.ggufGGUFQ3_K_M15.61 GBDownload
KAT-Coder-V2.5-Dev-Q3_K_S.ggufGGUFQ3_K_S14.14 GBDownload
KAT-Coder-V2.5-Dev-Q4_0.ggufGGUFQ4_018.36 GBDownload
KAT-Coder-V2.5-Dev-Q4_1.ggufGGUFQ4_120.35 GBDownload
KAT-Coder-V2.5-Dev-Q4_K_M.ggufGGUFQ4_K_M19.71 GBDownload
KAT-Coder-V2.5-Dev-Q4_K_S.ggufGGUFQ4_K_S18.52 GBDownload
KAT-Coder-V2.5-Dev-Q5_0.ggufGGUFQ5_022.33 GBDownload
KAT-Coder-V2.5-Dev-Q5_1.ggufGGUFQ5_124.32 GBDownload
KAT-Coder-V2.5-Dev-Q5_K_M.ggufGGUFQ5_K_M23.03 GBDownload
KAT-Coder-V2.5-Dev-Q5_K_S.ggufGGUFQ5_K_S22.33 GBDownload
KAT-Coder-V2.5-Dev-Q6_K.ggufGGUFQ6_K26.56 GBDownload
KAT-Coder-V2.5-Dev-Q8_0.ggufGGUFQ8_034.37 GBDownload

Model Details

Model IDRemySkye/KAT-Coder-V2.5-Dev-GGUF
AuthorRemySkye
Pipelinetext-generation
Licenseapache-2.0
Base modelKwaipilot/KAT-Coder-V2.5-Dev
Last modified2026-07-24T06:39:33.000Z

Model README

---

license: apache-2.0

library_name: llama.cpp

pipeline_tag: text-generation

base_model:

  • Kwaipilot/KAT-Coder-V2.5-Dev

base_model_relation: quantized

quantized_by: RemySkye

tags:

  • gguf
  • llama.cpp
  • quantized
  • text-generation
  • code
  • coding
  • agentic-coding
  • mixture-of-experts
  • moe
  • qwen3.5
  • qwen3.6

---

KAT-Coder-V2.5-Dev-GGUF

GGUF files for Kwaipilot/KAT-Coder-V2.5-Dev, including a BF16 reference GGUF and multiple llama.cpp quantizations.

What is included

| File | Format | Size |

|---|---:|---:|

| KAT-Coder-V2.5-Dev-BF16.gguf | BF16 | 64.61 GiB |

| KAT-Coder-V2.5-Dev-Q8_0.gguf | Q8_0 | 34.37 GiB |

| KAT-Coder-V2.5-Dev-Q6_K.gguf | Q6_K | 26.56 GiB |

| KAT-Coder-V2.5-Dev-Q5_K_M.gguf | Q5_K_M | 23.03 GiB |

| KAT-Coder-V2.5-Dev-Q5_1.gguf | Q5_1 | 24.32 GiB |

| KAT-Coder-V2.5-Dev-Q5_0.gguf | Q5_0 | 22.33 GiB |

| KAT-Coder-V2.5-Dev-Q5_K_S.gguf | Q5_K_S | 22.33 GiB |

| KAT-Coder-V2.5-Dev-Q4_K_M.gguf | Q4_K_M | 19.71 GiB |

| KAT-Coder-V2.5-Dev-Q4_1.gguf | Q4_1 | 20.35 GiB |

| KAT-Coder-V2.5-Dev-Q4_0.gguf | Q4_0 | 18.36 GiB |

| KAT-Coder-V2.5-Dev-Q4_K_S.gguf | Q4_K_S | 18.52 GiB |

| KAT-Coder-V2.5-Dev-IQ4_XS.gguf | IQ4_XS | 17.64 GiB |

| KAT-Coder-V2.5-Dev-Q3_K_L.gguf | Q3_K_L | 16.87 GiB |

| KAT-Coder-V2.5-Dev-Q3_K_M.gguf | Q3_K_M | 15.61 GiB |

| KAT-Coder-V2.5-Dev-Q3_K_S.gguf | Q3_K_S | 14.14 GiB |

| KAT-Coder-V2.5-Dev-Q2_K.gguf | Q2_K | 12.05 GiB |

All model behavior, intended use, limitations, and licensing originate from Kwaipilot/KAT-Coder-V2.5-Dev.

Run RemySkye/KAT-Coder-V2.5-Dev-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models