GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

Myric/KAT-Coder-V2.5-Dev-APEX-GGUF overview

Moved → Myric/KAT Coder V2.5 Dev MTP APEX GGUF https://huggingface.co/Myric/KAT Coder V2.5 Dev MTP APEX GGUF The APEX quants of Kwaipilot/KAT Coder V2.5 Dev ht…

ggufmoeapexquantizedimatrixqwen3_5_moecodingllama.cpptext-generationbase_model:Kwaipilot/KAT-Coder-V2.5-Devbase_model:quantized:Kwaipilot/KAT-Coder-V2.5-Devlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~18.79 GB disk (24 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
431
Likes
1
Pipeline
text-generation
Author

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
KAT-Coder-V2.5-Dev-APEX-i-quality-v2.ggufGGUFGGUF18.80 GBDownload
KAT-Coder-V2.5-Dev-APEX-i-quality.ggufGGUFGGUF18.79 GBDownload

Model Details

Model IDMyric/KAT-Coder-V2.5-Dev-APEX-GGUF
AuthorMyric
Pipelinetext-generation
Licenseapache-2.0
Base modelKwaipilot/KAT-Coder-V2.5-Dev
Last modified2026-08-21T16:50:12.000Z

Model README

---

license: apache-2.0

base_model: Kwaipilot/KAT-Coder-V2.5-Dev

pipeline_tag: text-generation

library_name: gguf

tags:

- gguf

- moe

- apex

- quantized

- imatrix

- qwen3_5_moe

- coding

- llama.cpp

---

Moved → Myric/KAT-Coder-V2.5-Dev-MTP-APEX-GGUF

The APEX quants of Kwaipilot/KAT-Coder-V2.5-Dev

now live in a single repo:

Myric/KAT-Coder-V2.5-Dev-MTP-APEX-GGUF

| file | size | |

|---|---:|---|

| KAT-Coder-V2.5-Dev-MTP-APEX-i-quality.gguf | 20.72 GB | recommended — includes a working MTP head for speculative decoding |

| KAT-Coder-V2.5-Dev-APEX-dynamic.gguf | 11.86 GiB | sized for a 16 GB card |

| kat-coder.imatrix | 192 MB | the importance matrix, reusable for your own tiers |

| model-00014-of-mtp.safetensors | 1.69 GB | the bf16 MTP head, if you want to redo the transplant |

KAT-Coder ships mtp_num_hidden_layers: 0 — no MTP head at all, so no speculative decoding is

possible out of the box, and that is true of the vendor release and of every other quant of this

model I am aware of. The build above transplants Qwen3.6-35B-A3B's own trained head onto it:

2.03× on a hard agentic-coding suite with correctness unchanged (100% on both suites either

way — the head only drafts, the main model verifies).

*This repo previously held only the imatrix, while its README described quants that were never

uploaded here. Everything is now in the repo linked above.*

Run Myric/KAT-Coder-V2.5-Dev-APEX-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models