KeinNiemand/Kuwutu-7B-CYOA-IK-GGUF-v2 overview
Kuwutu 7B CYOA IK GGUF v2 IK specific GGUF quantizations of Kuwutu 7B CYOA v2 https://huggingface.co/KeinNiemand/Kuwutu 7B CYOA v2?not for all audiences=true ,…
Runs locally from ~2.63 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Kuwutu-7B-CYOA-v2-IQ2_KL.gguf | GGUF | IQ2_KL | 2.63 GB | Download |
| Kuwutu-7B-CYOA-v2-IQ3_K.gguf | GGUF | IQ3_K | 3.23 GB | Download |
| Kuwutu-7B-CYOA-v2-IQ4_K.gguf | GGUF | IQ4_K | 4.17 GB | Download |
| Kuwutu-7B-CYOA-v2-IQ4_KS.gguf | GGUF | IQ4_KS | 3.97 GB | Download |
| Kuwutu-7B-CYOA-v2-IQ4_KSS.gguf | GGUF | IQ4_KSS | 3.77 GB | Download |
| Kuwutu-7B-CYOA-v2-IQ5_K.gguf | GGUF | IQ5_K | 4.96 GB | Download |
| Kuwutu-7B-CYOA-v2-IQ5_KS.gguf | GGUF | IQ5_KS | 4.77 GB | Download |
| Kuwutu-7B-CYOA-v2-IQ6_K.gguf | GGUF | IQ6_K | 5.89 GB | Download |
Model Details
| Model ID | KeinNiemand/Kuwutu-7B-CYOA-IK-GGUF-v2 |
|---|---|
| Author | KeinNiemand |
| Pipeline | text-generation |
| License | cc-by-nc-4.0 |
| Base model | KeinNiemand/Kuwutu-7B-CYOA-v2 |
| Last modified | 2026-07-15T08:55:44.000Z |
Model README
---
base_model: KeinNiemand/Kuwutu-7B-CYOA-v2
base_model_relation: quantized
license: cc-by-nc-4.0
pipeline_tag: text-generation
language:
- en
tags:
- gguf
- quantization
- ik_llama.cpp
- qwen2
- chatml
- interactive-fiction
- cyoa
- nsfw
- explicit
- not-for-all-audiences
---
Kuwutu-7B-CYOA-IK-GGUF-v2
IK-specific GGUF quantizations of Kuwutu-7B-CYOA-v2, a model for CYOA-style interactive fiction.
These files require ikawrakow/ik_llama.cpp. For mainline-compatible files, use Kuwutu-7B-CYOA-GGUF-v2.
See the full model card for model details.
Files
Kuwutu-7B-CYOA-v2-IQ6_K.ggufKuwutu-7B-CYOA-v2-IQ5_K.ggufKuwutu-7B-CYOA-v2-IQ5_KS.ggufKuwutu-7B-CYOA-v2-IQ4_K.ggufKuwutu-7B-CYOA-v2-IQ4_KS.ggufKuwutu-7B-CYOA-v2-IQ4_KSS.ggufKuwutu-7B-CYOA-v2-IQ3_K.ggufKuwutu-7B-CYOA-v2-IQ2_KL.gguf
The quantizations use an importance matrix generated from representative project calibration text.
Run KeinNiemand/Kuwutu-7B-CYOA-IK-GGUF-v2 with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models