GraySoft
Download guIDE →
Model Comparison

jackrong/qwen3.5-0.8b-claude-4.6-opus-reasoning-distilled-ggufvsprism-ml/bonsai-8b-gguf

Side-by-side comparison of jackrong/qwen3.5-0.8b-claude-4.6-opus-reasoning-distilled-gguf and prism-ml/bonsai-8b-gguf: downloads, license, context length, tasks, and benchmarks.

jackrong/qwen3.5-0.8b-claude-4.6-opus-reasoning-distilled-gguf

Jackrong · text-generation

prism-ml/bonsai-8b-gguf

prism-ml · text-generation

End-to-end 1-bit language model for llama.cpp (CUDA, Metal, CPU) > **14.1x** smaller than FP16 | **6.2x** faster on RTX 4090 | **4-5x** lower energy/token

Side-by-side Specifications

jackrong/qwen3.5-0.8b-claude-4.6-opus-reasoning-distilled-ggufprism-ml/bonsai-8b-gguf
AuthorJackrongprism-ml
Pipeline Tasktext-generationtext-generation
Library—llama.cpp
Downloads31,48883,309
Likes48618
LicenseUnknownUnknown
Context Length——
Created2026-03-052026-03-18
Last Modified2026-03-062026-04-16
Tags
ggufqwen3_5unslothqwenqwen3.5qwen3.5-0.8Breasoningchain-of-thoughtloratext-generation
llama.cppgguf1-bitllama-cppcudametalon-deviceprismmlbonsaitext-generation

View full details: jackrong/qwen3.5-0.8b-claude-4.6-opus-reasoning-distilled-gguf · prism-ml/bonsai-8b-gguf