Model Intelligence Sheet
DevQuasar/moonshotai.Kimi-K3-GGUF overview
<img src="https://raw.githubusercontent.com/csabakecskemeti/devquasar/main/dq logo black transparent.png" width="200"/ https://devquasar.com 'Make knowledge fr…
Runs locally from ~3.03 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
70 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Q2_K/moonshotai.Kimi-K3.Q2_K-00001-of-00070.gguf | GGUF | Q2_K | 12.00 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00002-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00003-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00004-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00005-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00006-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00007-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00008-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00009-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00010-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00011-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00012-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00013-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00014-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00015-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00016-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00017-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00018-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00019-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00020-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00021-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00022-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00023-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00024-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00025-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00026-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00027-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00028-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00029-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00030-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00031-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00032-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00033-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00034-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00035-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00036-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00037-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00038-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00039-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00040-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00041-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00042-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00043-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00044-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00045-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00046-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00047-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00048-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00049-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00050-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00051-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00052-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00053-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00054-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00055-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00056-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00057-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00058-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00059-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00060-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00061-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00062-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00063-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00064-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00065-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00066-of-00070.gguf | GGUF | Q2_K | 13.25 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00067-of-00070.gguf | GGUF | Q2_K | 13.40 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00068-of-00070.gguf | GGUF | Q2_K | 14.14 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00069-of-00070.gguf | GGUF | Q2_K | 13.21 GB | Download |
| Q2_K/moonshotai.Kimi-K3.Q2_K-00070-of-00070.gguf | GGUF | Q2_K | 3.03 GB | Download |
Model Details
| Model ID | DevQuasar/moonshotai.Kimi-K3-GGUF |
|---|---|
| Author | DevQuasar |
| Pipeline | text-generation |
| License | — |
| Base model | moonshotai/Kimi-K3 |
| Last modified | 2026-07-28T15:37:45.000Z |
Model README
---
base_model:
- moonshotai/Kimi-K3
pipeline_tag: text-generation
---
'Make knowledge free for everyone'
Experimental!
at this point i'm not suggeting this to be used for anyting else than test!
Based on https://github.com/ggml-org/llama.cpp/pull/26185
Q2_K | text-only | 962200.03 MiB (2.90 BPW)
Simple zeroshot demo
!k3_early_demo-ezgif.com-video-to-gif-converter
Quantized version of: moonshotai/Kimi-K3
<a href='https://ko-fi.com/L4L416YX7C' target='_blank'><img height='36' style='border:0px;height:36px;' src='https://storage.ko-fi.com/cdn/kofi6.png?v=6' border='0' alt='Buy Me a Coffee at ko-fi.com' /></a>
Run DevQuasar/moonshotai.Kimi-K3-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models