GraySoft
Download guIDE →
Model Comparison

ggml-org/qwen3-reranker-0.6b-q8_0-ggufvsunsloth/deepseek-r1-distill-llama-70b-gguf

Side-by-side comparison of ggml-org/qwen3-reranker-0.6b-q8_0-gguf and unsloth/deepseek-r1-distill-llama-70b-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/qwen3-reranker-0.6b-q8_0-gguf

ggml-org · text-ranking

This model was converted to GGUF format from Qwen/Qwen3-Reranker-0.6B using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

unsloth/deepseek-r1-distill-llama-70b-gguf

unsloth · text-generation

We have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Alpaca.ipynb

Side-by-side Specifications

ggml-org/qwen3-reranker-0.6b-q8_0-ggufunsloth/deepseek-r1-distill-llama-70b-gguf
Authorggml-orgunsloth
Pipeline Tasktext-rankingtext-generation
Librarytransformerstransformers
Downloads33,06120,715
Likes14110
LicenseUnknownUnknown
Context Length——
Created2025-10-032025-01-20
Last Modified2025-10-032025-05-10
Tags
transformersggufllama-cppgguf-my-repotext-rankingbase_model:Qwen/Qwen3-Reranker-0.6Bbase_model:quantized:Qwen/Qwen3-Reranker-0.6Blicense:apache-2.0endpoints_compatibleregion:us
transformersggufllamatext-generationdeepseekunslothllama-3metaenarxiv:2501.12948

View full details: ggml-org/qwen3-reranker-0.6b-q8_0-gguf · unsloth/deepseek-r1-distill-llama-70b-gguf