GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

leeaandrob/Bonsai-27B-1bit-gguf overview

Bonsai 27B · 1 bit Q1 0 GGUF — for the SuperSeed AI Agent The model the SuperSeed AI Agent app downloads when you switch on Local model NeuroGrid : PrismML's B…

neurogridgguf1-bitq1_0bonsaiqwen3.5superseedtext-generationenpteslicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~600.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Bonsai-27B-Q1_0.ggufGGUFQ1_03.54 GBDownload
Bonsai-27B-mmproj-Q8_0.ggufGGUFQ8_0600.1 MBDownload

Model Details

Model IDleeaandrob/Bonsai-27B-1bit-gguf
Authorleeaandrob
Pipelinetext-generation
Licenseapache-2.0
Base modelprism-ml/Bonsai-27B
Last modified2026-09-11T13:10:04.000Z

Model README

---

license: apache-2.0

base_model: prism-ml/Bonsai-27B

base_model_relation: quantized

tags:

- gguf

- 1-bit

- q1_0

- bonsai

- qwen3.5

- neurogrid

- superseed

language:

- en

- pt

- es

pipeline_tag: text-generation

library_name: neurogrid

---

Bonsai-27B · 1-bit (Q1_0) GGUF — for the SuperSeed AI Agent

The model the SuperSeed AI Agent app downloads when you switch on *Local model

(NeuroGrid)*: PrismML's Bonsai-27B

(Qwen3.5 architecture, 27B parameters) in 1-bit Q1_0 — every projection stored

as one sign bit per weight with an fp16 scale per 128-weight block. 3.6 GB on disk,

3.6 GB pinned in RAM while it runs.

| file | size | what |

|---|---|---|

| Bonsai-27B-Q1_0.gguf | 3.54 GiB | language model, Q1_0 |

| Bonsai-27B-mmproj-Q8_0.gguf | 0.59 GiB | vision projector (optional) |

These are byte-identical redistributions of the files in

prism-ml/Bonsai-27B-gguf

(Apache-2.0). Credit for the model and the quantization belongs to PrismML.

How it runs

The SuperSeed AI Agent embeds the NeuroGrid engine as a

sidecar (neurogrid -solo) and runs this file on the CPU with NEON SDOT kernels

written for the Q1_0 block layout (bit=1 → +d, bit=0 → −d), weights mlock'd so

they never fall out of RAM, on the performance cores only. On an Apple M5 with

16 GB it loads in ~4 s and decodes at ~3–3.5 tok/s while the laptop stays usable.

Everything you type stays on the machine.

Also runs with PrismML's llama.cpp fork (Q1_0 is not in upstream llama.cpp).

License

Apache-2.0, same as the original.

Run leeaandrob/Bonsai-27B-1bit-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models