ggml-org/qwen3-reranker-0.6b-q8_0-gguf - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
ggml-org/qwen3-reranker-0.6b-q8_0-gguf overview
This model was converted to GGUF format from Qwen/Qwen3-Reranker-0.6B using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.
Downloads
33,061
Likes
14
Pipeline
text-ranking
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
1 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| qwen3-reranker-0.6b-q8_0.gguf | GGUF | — | 609.54 MB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"base_model": "Qwen/Qwen3-Reranker-0.6B",
"library_name": "transformers",
"pipeline_tag": "text-ranking",
"tags": [
"llama-cpp",
"gguf-my-repo"
],
"frontmatter": {
"license": "apache-2.0",
"base_model": "Qwen/Qwen3-Reranker-0.6B",
"library_name": "transformers",
"pipeline_tag": "text-ranking",
"tags": [
"llama-cpp",
"gguf-my-repo"
]
},
"hero_image_url": "",
"summary": "This model was converted to GGUF format from Qwen/Qwen3-Reranker-0.6B using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\nbase_model: Qwen/Qwen3-Reranker-0.6B\nlibrary_name: transformers\npipeline_tag: text-ranking\ntags:\n- llama-cpp\n- gguf-my-repo\n---\n\n# ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF\nThis model was converted to GGUF format from [`Qwen/Qwen3-Reranker-0.6B`](https://huggingface.co/Qwen/Qwen3-Reranker-0.6B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.\nRefer to the [original model card](https://huggingface.co/Qwen/Qwen3-Reranker-0.6B) for more details on the model.",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"llama-cpp",
"gguf-my-repo",
"text-ranking",
"base_model:Qwen/Qwen3-Reranker-0.6B",
"base_model:quantized:Qwen/Qwen3-Reranker-0.6B",
"license:apache-2.0",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 14,
"downloads": 33061,
"gated": false,
"private": false,
"last_modified": "2025-10-03T10:19:38.000Z",
"created_at": "2025-10-03T10:14:11.000Z",
"pipeline_tag": "text-ranking",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "68dfa1f350ddd846f166e8d6",
"id": "ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF",
"modelId": "ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF",
"sha": "a02f48bb4f057028298c21fa033da2b30d7742d5",
"createdAt": "2025-10-03T10:14:11.000Z",
"lastModified": "2025-10-03T10:19:38.000Z",
"author": "ggml-org",
"downloads": 33061,
"likes": 14,
"gated": false,
"private": false,
"pipeline_tag": "text-ranking",
"library_name": "transformers",
"siblings_count": 3
}