zenlm/zen-5-mini-gguf overview
Zen5 Mini Frontier agentic tier of the Zen5 https://zenlm.org family at the lowest cost in the lineup. Zen agentic MoE with ~10B active parameters per token; t…
Runs locally from ~128.84 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| MiniMax-M2.5-abliterated-Q4_K_M.gguf | GGUF | Q4_K_M | 128.84 GB | Download |
Model Details
| Model ID | zenlm/zen-5-mini-gguf |
|---|---|
| Author | zenlm |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | — |
| Last modified | 2026-06-26T08:58:12.000Z |
Model README
---
license: apache-2.0
library_name: gguf
pipeline_tag: text-generation
language:
- en
- zh
tags:
- zen5
- zen5-mini
- zenlm
- hanzo
- gguf
- moe
- agentic
- zen-5
---
Zen5 Mini
Frontier-agentic tier of the Zen5 family at the lowest cost in the lineup. Zen agentic MoE with ~10B active parameters per token; trained on large-scale real-world environment RL for tool use, code, and multi-step reasoning.
Part of the canonical Zen5 ladder:
| SKU | Hardware fit | This repo |
|---|---|---|
| zen5-flash | anything (4 GB VRAM) | zen-5-flash-gguf |
| zen5-mini | 32 GB unified RAM (Q4_K_M) | ← you are here |
| zen5 (default) | 24 GB+ VRAM | zen-5-gguf |
| zen5-pro | Mac M4 Max / DGX Spark / H100 80GB | zen-5-pro-gguf |
| zen5-max | Mac Studio M3 Ultra 512GB / 8x H100 | zen-5-max-gguf |
Files
| File | Size | Quant |
|---|---|---|
| main GGUF (*-Q4_K_M.gguf) | ~140 GB | Q4_K_M, refusal-orthogonalized |
Run
Hosted via the Hanzo gateway (api.hanzo.ai) as zen5-mini.
Local with llama.cpp or compatible:
hf download zenlm/zen-5-mini-gguf --local-dir gguf
MAIN=$(ls gguf/*-Q4_K_M.gguf | head -1)
llama-cli -m "$MAIN" -p "Reply in one sentence: what year is it?"Run zenlm/zen-5-mini-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models