GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

groxaxo/Bonsai-2-27B-PQ2_0-MTP-GGUF overview

Bonsai 2 27B PQ2 0 MTP GGUF This repository publishes the local file Bonsai 2 27B PQ2 0 MTP.gguf 7,557,178,656 bytes from decent jawfish/bonsai 2 27b mtp https…

ggufqwen3.5mtptext-generationbase_model:decent-jawfish/bonsai-2-27b-mtpbase_model:quantized:decent-jawfish/bonsai-2-27b-mtplicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~7.04 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Bonsai-2-27B-PQ2_0-MTP.ggufGGUFGGUF7.04 GBDownload

Model Details

Model IDgroxaxo/Bonsai-2-27B-PQ2_0-MTP-GGUF
Authorgroxaxo
Pipelinetext-generation
Licenseapache-2.0
Base modeldecent-jawfish/bonsai-2-27b-mtp
Last modified2026-10-06T12:07:32.000Z

Model README

---

license: apache-2.0

base_model: decent-jawfish/bonsai-2-27b-mtp

base_model_relation: quantized

library_name: gguf

pipeline_tag: text-generation

tags:

- gguf

- qwen3.5

- mtp

---

Bonsai-2-27B PQ2_0 MTP GGUF

This repository publishes the local file Bonsai-2-27B-PQ2_0-MTP.gguf (7,557,178,656 bytes) from decent-jawfish/bonsai-2-27b-mtp. That model card reports Apache-2.0. groxaxo did not quantize this file.

The GGUF header has no license field. It records architecture qwen35, size label 27B, basename folded, and general.file_type 141. The filename identifies the PQ2_0 MTP quant.

A 27 September 2026 bench note records SHA-256 78df4279d40ebebdccfd2dae0e9d4847afee52e94f48f3542ae9437220dbd847 for this filename. The upload checks that hash before publishing. SHA256SUMS is the hash of the uploaded bytes.

This file was benchmarked on another machine on 27 September 2026. That run was not repeated for this upload. The llama.cpp command recorded for that bench was:

llama-server -m Bonsai-2-27B-PQ2_0-MTP.gguf --alias bonsai-27b-pq2-mtp --jinja \
  -ngl 999 -fa on -c 16384 -np 1 -ctk q8_0 -ctv q8_0 \
  --temp 1.0 --top-p 0.95 --top-k 20 --min-p 0.05 \
  --spec-type draft-mtp --spec-draft-n-max 2

The measured scores stay in that bench write-up. They are not a new result for this repository.

Run groxaxo/Bonsai-2-27B-PQ2_0-MTP-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models