GraySoft
Download guIDE →
Model Comparison

mradermacher/huihui-qwen3.5-9b-abliterated-ggufvsprism-ml/bonsai-8b-gguf

Side-by-side comparison of mradermacher/huihui-qwen3.5-9b-abliterated-gguf and prism-ml/bonsai-8b-gguf: downloads, license, context length, tasks, and benchmarks.

mradermacher/huihui-qwen3.5-9b-abliterated-gguf

mradermacher · —

## About static quants of https://huggingface.co/huihui-ai/Huihui-Qwen3.5-9B-abliterated ***For a convenient overview and download list, visit our model page for this model.*** weighted/imatrix quants are available at https://huggingface.co/mradermacher/Huihui-Qwen3.5-9B-abliter…

prism-ml/bonsai-8b-gguf

prism-ml · text-generation

End-to-end 1-bit language model for llama.cpp (CUDA, Metal, CPU) > **14.1x** smaller than FP16 | **6.2x** faster on RTX 4090 | **4-5x** lower energy/token

Side-by-side Specifications

mradermacher/huihui-qwen3.5-9b-abliterated-ggufprism-ml/bonsai-8b-gguf
Authormradermacherprism-ml
Pipeline Task—text-generation
Librarytransformersllama.cpp
Downloads27,41283,309
Likes13618
LicenseUnknownUnknown
Context Length——
Created2026-03-102026-03-18
Last Modified2026-03-102026-04-16
Tags
transformersggufabliterateduncensoredenbase_model:huihui-ai/Huihui-Qwen3.5-9B-abliteratedbase_model:quantized:huihui-ai/Huihui-Qwen3.5-9B-abliteratedlicense:apache-2.0endpoints_compatibleregion:us
llama.cppgguf1-bitllama-cppcudametalon-deviceprismmlbonsaitext-generation

View full details: mradermacher/huihui-qwen3.5-9b-abliterated-gguf · prism-ml/bonsai-8b-gguf