GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

freakyskittle/kimi-k2.75-code-GGUF overview

Kimi K2.75 Code — GGUF GGUF conversions and quantizations of the experimental merged checkpoint freakyskittle/kimi k2.75 code https://huggingface.co/freakyskit…

ggufmergekimideepseek-v3moequantizedexperimentaltext-generationbase_model:freakyskittle/kimi-k2.75-codebase_model:merge:freakyskittle/kimi-k2.75-codebase_model:moonshotai/Kimi-K2.6base_model:merge:moonshotai/Kimi-K2.6base_model:moonshotai/Kimi-K2.7-Codebase_model:merge:moonshotai/Kimi-K2.7-Codelicense:otherendpoints_compatibleregion:us

Runs locally from ~188.74 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).

Downloads
3,178
Likes
1
Pipeline
text-generation

Repository Files & Downloads

5 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
deep55/k2-merged-pruned-deep55.ggufGGUFGGUF188.74 GBDownload
llamacpp-q4-partial/k2-merged-llamacpp-Q4_K_M.partial.ggufGGUFQ4405.32 GBDownload
pruned-compact-oxidize-q4/k2-merged-oxidize-Q4_K_M.ggufGGUFQ4377.79 GBDownload
unpruned-q8/k2-merged-Q8_0-00001-of-00002.ggufGGUFQ8416.98 GBDownload
unpruned-q8/k2-merged-Q8_0-00002-of-00002.ggufGGUFQ8295.65 GBDownload

Model Details

Model IDfreakyskittle/kimi-k2.75-code-GGUF
Authorfreakyskittle
Pipelinetext-generation
Licenseother
Base modelfreakyskittle/kimi-k2.75-code,moonshotai/Kimi-K2.7-Code,moonshotai/Kimi-K2.6
Last modified2026-07-08T15:37:46.000Z

Model README

---

license: other

base_model:

- freakyskittle/kimi-k2.75-code

- moonshotai/Kimi-K2.7-Code

- moonshotai/Kimi-K2.6

tags:

- gguf

- merge

- kimi

- deepseek-v3

- moe

- quantized

- experimental

pipeline_tag: text-generation

---

Kimi K2.75 Code — GGUF

GGUF conversions and quantizations of the experimental merged checkpoint

freakyskittle/kimi-k2.75-code

(a shard-wise SLERP merge of moonshotai/Kimi-K2.7-Code and moonshotai/Kimi-K2.6,

DeepSeek-V3 style MoE).

See the base repository for the full merge recipe, pruning details, and license.

> Parameter count: ~720 B. The bf16 and Q8_0 builds contain 1,096 tensors

> summing to 719.8 B parameters. Hugging Face's auto-detected badge reads ~61 B

> because it parses the deep55/ file first, and that build stores weights in a

> packed-int4 layout (int32 weight_packed tensors holding 8 weights each, plus

> weight_scale/weight_shape) whose logical shapes can't be summed. The true

> model is ~720 B params (further reduced in the deep-pruned deep55/ variant).

Files

Each variant lives in its own folder. Files over Hugging Face's 500 GB per-file

limit are split into GGUF shards (-0000N-of-0000M.gguf); point your loader at the

first shard and the rest are picked up automatically.

| Folder | Variant | Approx. size | Notes |

|--------|---------|--------------|-------|

| deep55/ | Deep-pruned, full precision | ~203 GB | Prune ratio 0.55, deepseek_v3 arch override |

| pruned-compact-oxidize-q4/ | Q4_K_M (oxidize) | ~406 GB | Quantized from the compacted pruned checkpoint |

| llamacpp-q4-partial/ | Q4_K_M (llama.cpp, partial) | ~435 GB | Partial llama.cpp quantization |

| unpruned-q8/ | Q8_0 (unpruned) | ~765 GB | Split into 2 shards |

| pruned-bf16/ | BF16 (pruned) | ~1.44 TB | Split into 4 shards |

Provenance

  • Base merge + pruning: see freakyskittle/kimi-k2.75-code.
  • GGUF conversion via oxidize-convert with --arch deepseek_v3.
  • Sharding via llama-gguf-split (--split-max-size 450G).

Status

Experimental research artifact — not fully evaluated. Validate quality before any

production use. Use at your own risk.

License

Follows the Modified MIT License from Moonshot AI (see the base repository). Commercial

attribution requirement applies: products/services exceeding 100M monthly active users

or US$20M monthly revenue must prominently display Kimi K2.7 Code in the UI.

Run freakyskittle/kimi-k2.75-code-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models