leeaandrob/Bonsai-27B-1bit-gguf overview
Bonsai 27B · 1 bit Q1 0 GGUF — for the SuperSeed AI Agent The model the SuperSeed AI Agent app downloads when you switch on Local model NeuroGrid : PrismML's B…
Runs locally from ~600.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | leeaandrob/Bonsai-27B-1bit-gguf |
|---|---|
| Author | leeaandrob |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | prism-ml/Bonsai-27B |
| Last modified | 2026-09-11T13:10:04.000Z |
Model README
---
license: apache-2.0
base_model: prism-ml/Bonsai-27B
base_model_relation: quantized
tags:
- gguf
- 1-bit
- q1_0
- bonsai
- qwen3.5
- neurogrid
- superseed
language:
- en
- pt
- es
pipeline_tag: text-generation
library_name: neurogrid
---
Bonsai-27B · 1-bit (Q1_0) GGUF — for the SuperSeed AI Agent
The model the SuperSeed AI Agent app downloads when you switch on *Local model
(NeuroGrid)*: PrismML's Bonsai-27B
(Qwen3.5 architecture, 27B parameters) in 1-bit Q1_0 — every projection stored
as one sign bit per weight with an fp16 scale per 128-weight block. 3.6 GB on disk,
3.6 GB pinned in RAM while it runs.
| file | size | what |
|---|---|---|
| Bonsai-27B-Q1_0.gguf | 3.54 GiB | language model, Q1_0 |
| Bonsai-27B-mmproj-Q8_0.gguf | 0.59 GiB | vision projector (optional) |
These are byte-identical redistributions of the files in
(Apache-2.0). Credit for the model and the quantization belongs to PrismML.
How it runs
The SuperSeed AI Agent embeds the NeuroGrid engine as a
sidecar (neurogrid -solo) and runs this file on the CPU with NEON SDOT kernels
written for the Q1_0 block layout (bit=1 → +d, bit=0 → −d), weights mlock'd so
they never fall out of RAM, on the performance cores only. On an Apple M5 with
16 GB it loads in ~4 s and decodes at ~3–3.5 tok/s while the laptop stays usable.
Everything you type stays on the machine.
Also runs with PrismML's llama.cpp fork (Q1_0 is not in upstream llama.cpp).
License
Apache-2.0, same as the original.
Run leeaandrob/Bonsai-27B-1bit-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models