GraySoft
Model Comparison

maziyarpanahi/qwen3-32b-ggufvsprism-ml/bonsai-8b-gguf

Side-by-side comparison of maziyarpanahi/qwen3-32b-gguf and prism-ml/bonsai-8b-gguf: downloads, license, context length, tasks, and benchmarks.

maziyarpanahi/qwen3-32b-gguf

MaziyarPanahi · text-generation

# MaziyarPanahi/Qwen3-32B-GGUF

prism-ml/bonsai-8b-gguf

prism-ml · text-generation

End-to-end 1-bit language model for llama.cpp (CUDA, Metal, CPU) > **14.1x** smaller than FP16 | **6.2x** faster on RTX 4090 | **4-5x** lower energy/token

Side-by-side Specifications

maziyarpanahi/qwen3-32b-ggufprism-ml/bonsai-8b-gguf
AuthorMaziyarPanahiprism-ml
Pipeline Tasktext-generationtext-generation
Libraryllama.cpp
Downloads146,14783,309
Likes2618
LicenseUnknownUnknown
Context Length
Created2025-04-282026-03-18
Last Modified2025-04-292026-04-16
Tags
ggufquantized2-bit3-bit4-bit5-bit6-bit8-bitGGUFtext-generation
llama.cppgguf1-bitllama-cppcudametalon-deviceprismmlbonsaitext-generation

View full details: maziyarpanahi/qwen3-32b-gguf · prism-ml/bonsai-8b-gguf