GraySoft
Model Comparison

microsoft/phi-3-mini-4k-instruct-ggufvsunsloth/deepseek-r1-distill-llama-70b-gguf

Side-by-side comparison of microsoft/phi-3-mini-4k-instruct-gguf and unsloth/deepseek-r1-distill-llama-70b-gguf: downloads, license, context length, tasks, and benchmarks.

microsoft/phi-3-mini-4k-instruct-gguf

microsoft · text-generation

output = llm( f"\n{prompt}\n", max_tokens=256, # Generate up to 256 tokens stop=[""], echo=True, # Whether to echo the prompt ) print(output['choices'][0]['text']) ```

unsloth/deepseek-r1-distill-llama-70b-gguf

unsloth · text-generation

We have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Alpaca.ipynb

Side-by-side Specifications

microsoft/phi-3-mini-4k-instruct-ggufunsloth/deepseek-r1-distill-llama-70b-gguf
Authormicrosoftunsloth
Pipeline Tasktext-generationtext-generation
Librarytransformers
Downloads69,43820,715
Likes576110
LicenseUnknownUnknown
Context Length
Created2024-04-222025-01-20
Last Modified2025-12-102025-05-10
Tags
ggufnlpcodetext-generationenlicense:mitendpoints_compatibleregion:usconversational
transformersggufllamatext-generationdeepseekunslothllama-3metaenarxiv:2501.12948

View full details: microsoft/phi-3-mini-4k-instruct-gguf · unsloth/deepseek-r1-distill-llama-70b-gguf