GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

lmstudio-community/Bonsai-27B-GGUF overview

Bonsai 27B GGUF Private LM Studio conversion of prism ml/Bonsai 27B unpacked https://huggingface.co/prism ml/Bonsai 27B unpacked . Files | File | Purpose | Siz…

ggufllama.cppmultimodalqwen35bonsai1-bitbase_model:prism-ml/Bonsai-27B-unpackedbase_model:quantized:prism-ml/Bonsai-27B-unpackedlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~888.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Bonsai-27B-Q1_0.ggufGGUFQ1_03.54 GBDownload
mmproj-Bonsai-27B-BF16.ggufGGUFBF16888.0 MBDownload

Model Details

Model IDlmstudio-community/Bonsai-27B-GGUF
Authorlmstudio-community
Pipeline
Licenseapache-2.0
Base modelprism-ml/Bonsai-27B-unpacked
Last modified2026-07-30T20:09:12.000Z

Model README

---

base_model: prism-ml/Bonsai-27B-unpacked

license: apache-2.0

library_name: gguf

tags:

  • gguf
  • llama.cpp
  • multimodal
  • qwen35
  • bonsai
  • 1-bit

---

Bonsai 27B GGUF

Private LM Studio conversion of prism-ml/Bonsai-27B-unpacked.

Files

| File | Purpose | Size |

| --- | --- | ---: |

| Bonsai-27B-Q1_0.gguf | Pure Q1_0 language model | 3.80 GB |

| mmproj-Bonsai-27B-BF16.gguf | BF16 vision projector | 0.93 GB |

The language model was converted with llama.cpp commit 0e4a0362239713ea95a6864a17a8de4b0ad90d62 using --no-mtp, then quantized with llama-quantize --pure ... Q1_0. Excluding MTP is required because the source configuration advertises one MTP layer while the checkpoint contains language blocks 0 through 63 only.

This repository intentionally does not include Prism’s separately packaged DSpark draft model. It therefore indexes as one 27B target plus one vision adapter in LM Studio.

Validation

Validated with llama-server and LM Studio/llmster:

  • qwen35.block_count = 64; no qwen35.nextn_predict_layers
  • Text and vision inference
  • Parallel tool calls
  • A three-stage tool workflow with nested JSON arguments and tool-result synthesis

Checksums

71d6871836886267f39f1ac69b1b1dd8a783970708d7a189960112ed02978901  Bonsai-27B-Q1_0.gguf
c4c09d300638f6d2759e1ffe94d97cf08be94b8c9dad6920509be1aab11fd8cb  mmproj-Bonsai-27B-BF16.gguf

Run lmstudio-community/Bonsai-27B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models