GraySoft
Model Comparison

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufvsunsloth/deepseek-r1-distill-llama-70b-gguf

Side-by-side comparison of hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf and unsloth/deepseek-r1-distill-llama-70b-gguf: downloads, license, context length, tasks, and benchmarks.

hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf

hugging-quants · text-generation

This model was converted to GGUF format from meta-llama/Llama-3.2-3B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

unsloth/deepseek-r1-distill-llama-70b-gguf

unsloth · text-generation

We have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Alpaca.ipynb

Side-by-side Specifications

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufunsloth/deepseek-r1-distill-llama-70b-gguf
Authorhugging-quantsunsloth
Pipeline Tasktext-generationtext-generation
Librarytransformers
Downloads23,87520,715
Likes27110
LicenseUnknownUnknown
Context Length
Created2024-09-252025-01-20
Last Modified2024-09-252025-05-10
Tags
gguffacebookmetapytorchllamallama-3llama-cppgguf-my-repotext-generationen
transformersggufllamatext-generationdeepseekunslothllama-3metaenarxiv:2501.12948

View full details: hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf · unsloth/deepseek-r1-distill-llama-70b-gguf