GraySoft
Download guIDE →
Model Comparison

ggml-org/qwen3-reranker-0.6b-q8_0-ggufvsunsloth/llama-3.2-1b-instruct-gguf

Side-by-side comparison of ggml-org/qwen3-reranker-0.6b-q8_0-gguf and unsloth/llama-3.2-1b-instruct-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/qwen3-reranker-0.6b-q8_0-gguf

ggml-org · text-ranking

This model was converted to GGUF format from Qwen/Qwen3-Reranker-0.6B using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

unsloth/llama-3.2-1b-instruct-gguf

unsloth · text-generation

16bit, 8bit, 6bit, 5bit, 4bit, 3bit and 2bit uploads avaliable. # Finetune Llama 3.2, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth! We have a free Google Colab Tesla T4 notebook for Llama 3.2 (3B) here: https://colab.research.google.com/drive/1T5-zKWM_5OD21QHwXH…

Side-by-side Specifications

ggml-org/qwen3-reranker-0.6b-q8_0-ggufunsloth/llama-3.2-1b-instruct-gguf
Authorggml-orgunsloth
Pipeline Tasktext-rankingtext-generation
Librarytransformerstransformers
Downloads33,06164,318
Likes1458
LicenseUnknownUnknown
Context Length——
Created2025-10-032024-09-25
Last Modified2025-10-032025-05-09
Tags
transformersggufllama-cppgguf-my-repotext-rankingbase_model:Qwen/Qwen3-Reranker-0.6Bbase_model:quantized:Qwen/Qwen3-Reranker-0.6Blicense:apache-2.0endpoints_compatibleregion:us
transformersggufllamatext-generationllama-3metafacebookunslothenbase_model:meta-llama/Llama-3.2-1B-Instruct

View full details: ggml-org/qwen3-reranker-0.6b-q8_0-gguf · unsloth/llama-3.2-1b-instruct-gguf