GraySoft
Download guIDE →
Model Comparison

ggml-org/qwen3-reranker-0.6b-q8_0-ggufvsprism-ml/bonsai-8b-gguf

Side-by-side comparison of ggml-org/qwen3-reranker-0.6b-q8_0-gguf and prism-ml/bonsai-8b-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/qwen3-reranker-0.6b-q8_0-gguf

ggml-org · text-ranking

This model was converted to GGUF format from Qwen/Qwen3-Reranker-0.6B using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

prism-ml/bonsai-8b-gguf

prism-ml · text-generation

End-to-end 1-bit language model for llama.cpp (CUDA, Metal, CPU) > **14.1x** smaller than FP16 | **6.2x** faster on RTX 4090 | **4-5x** lower energy/token

Side-by-side Specifications

ggml-org/qwen3-reranker-0.6b-q8_0-ggufprism-ml/bonsai-8b-gguf
Authorggml-orgprism-ml
Pipeline Tasktext-rankingtext-generation
Librarytransformersllama.cpp
Downloads33,06183,309
Likes14618
LicenseUnknownUnknown
Context Length——
Created2025-10-032026-03-18
Last Modified2025-10-032026-04-16
Tags
transformersggufllama-cppgguf-my-repotext-rankingbase_model:Qwen/Qwen3-Reranker-0.6Bbase_model:quantized:Qwen/Qwen3-Reranker-0.6Blicense:apache-2.0endpoints_compatibleregion:us
llama.cppgguf1-bitllama-cppcudametalon-deviceprismmlbonsaitext-generation

View full details: ggml-org/qwen3-reranker-0.6b-q8_0-gguf · prism-ml/bonsai-8b-gguf