GraySoft
Download guIDE →
Model Comparison

ggml-org/qwen3-reranker-0.6b-q8_0-ggufvsqwen/qwen2.5-7b-instruct-gguf

Side-by-side comparison of ggml-org/qwen3-reranker-0.6b-q8_0-gguf and qwen/qwen2.5-7b-instruct-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/qwen3-reranker-0.6b-q8_0-gguf

ggml-org · text-ranking

This model was converted to GGUF format from Qwen/Qwen3-Reranker-0.6B using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

qwen/qwen2.5-7b-instruct-gguf

Qwen · text-generation

Side-by-side Specifications

ggml-org/qwen3-reranker-0.6b-q8_0-ggufqwen/qwen2.5-7b-instruct-gguf
Authorggml-orgQwen
Pipeline Tasktext-rankingtext-generation
Librarytransformers—
Downloads33,06157,826
Likes14137
LicenseUnknownUnknown
Context Length——
Created2025-10-032024-09-17
Last Modified2025-10-032024-09-20
Tags
transformersggufllama-cppgguf-my-repotext-rankingbase_model:Qwen/Qwen3-Reranker-0.6Bbase_model:quantized:Qwen/Qwen3-Reranker-0.6Blicense:apache-2.0endpoints_compatibleregion:us
ggufchattext-generationenarxiv:2407.10671base_model:Qwen/Qwen2.5-7B-Instructbase_model:quantized:Qwen/Qwen2.5-7B-Instructlicense:apache-2.0endpoints_compatibleregion:us

View full details: ggml-org/qwen3-reranker-0.6b-q8_0-gguf · qwen/qwen2.5-7b-instruct-gguf