darioooooo0o/K2-Horizon-0.9B-GGUF overview
K2 Horizon 0.9B GGUF quants X https://img.shields.io/badge/X Follow 000000?logo=x&logoColor=white https://x.com/imdariotoo Requests, questions or suggestions? …
Runs locally from ~524.4 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | darioooooo0o/K2-Horizon-0.9B-GGUF |
|---|---|
| Author | darioooooo0o |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | IFM/K2-Horizon-0.9B |
| Last modified | 2026-09-03T18:56:39.000Z |
Model README
---
license: apache-2.0
base_model: IFM/K2-Horizon-0.9B
pipeline_tag: text-generation
library_name: gguf
tags:
- k2-horizon
- llama.cpp
- gguf
- k-quants
---
K2-Horizon-0.9B GGUF quants
Requests, questions or suggestions? Message me on X: https://x.com/imdariotoo
GGUF quantizations of IFM/K2-Horizon-0.9B.
Converted with the official k2-official llama.cpp branch (MBZUAI-IFM port, commit 35999d101).
Files
| File | Quant | Size |
|---|---|---|
| k2horizon-q3_k_m.gguf | Q3_K_M | ~0.5 GB |
| k2horizon-q4_k_s.gguf | Q4_K_S | ~0.6 GB |
| k2horizon-q4_k_m.gguf | Q4_K_M | ~0.6 GB |
| k2horizon-q5_k_m.gguf | Q5_K_M | ~0.7 GB |
| k2horizon-q8_0.gguf | Q8_0 | ~1.1 GB |
Requirements
Use a llama.cpp build from the k2-official branch of MBZUAI-IFM/llama.cpp (or anything that merges that port). Mainline llama.cpp does NOT support the k2-horizon architecture.
Usage
llama-cli -m k2horizon-q4_k_m.gguf -ngl 99 -c 8192Fits entirely on any modern GPU (even iGPU); no CPU offload needed.
Notes
- Plain K-quants from BF16, no imatrix.
- All quants verified loading and generating on RTX 3060 12GB.
Run darioooooo0o/K2-Horizon-0.9B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models