zenlm/zen-5-nano-4B-gguf overview
Zen5 Nano 4B Edge / mobile / on device tier of the Zen5 https://zenlm.org family. Multimodal image + text in → text out dense model at the 5B parameter scale, …
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Browse files on Hugging Face | ||||
Model Details
| Model ID | zenlm/zen-5-nano-4B-gguf |
|---|---|
| Author | zenlm |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | — |
| Last modified | 2026-06-26T08:58:28.000Z |
Model README
---
license: apache-2.0
library_name: gguf
pipeline_tag: image-text-to-text
language:
- en
- zh
tags:
- zen5
- zen5-nano
- zen5-nano-4B
- zenlm
- hanzo
- multimodal
- vision-language
- edge
- mobile
- zen-5
---
Zen5 Nano 4B
Edge / mobile / on-device tier of the Zen5 family. Multimodal (image + text in → text out) dense model at the 5B-parameter scale, tuned for fast on-device inference on phones, laptops, and Raspberry Pi class hardware.
Part of the Zen5 nano sub-family — pick by hardware budget:
| SKU | Params | Fit |
|---|---|---|
| zen5-nano-0.8B | 0.9B | Raspberry Pi 5 / phone CPU / browser WASM |
| zen5-nano-2B | 2B | low-end iGPU / 8 GB RAM laptop |
| zen5-nano-4B | 5B | 16 GB RAM laptop / mobile NPU |
| zen5-nano-9B | 10B | 24 GB+ unified RAM / consumer GPU |
The larger tiers (zen5-flash, zen5, zen5-pro, zen5-max, zen5-coder) cover everything from agentic-default to frontier-quality multi-GPU.
Weights
GGUF mirror is staged. Until it lands here, the recommended path is the hosted zen5-nano-4B endpoint below, or any community 5B-class multimodal GGUF placed in a local model/ directory.
Run
Hosted via the Hanzo gateway (api.hanzo.ai) as zen5-nano-4B.
Local with llama.cpp or any GGUF runtime:
llama-cli -m model.gguf --mmproj mmproj.gguf -p "What is shown in this image?"Run zenlm/zen-5-nano-4B-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models