GraySoft
Model Comparison

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-ggufvsunsloth/llama-3.2-3b-instruct-gguf

Side-by-side comparison of tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf and unsloth/llama-3.2-3b-instruct-gguf: downloads, license, context length, tasks, and benchmarks.

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

unsloth/llama-3.2-3b-instruct-gguf

unsloth · text-generation

16bit, 8bit, 6bit, 5bit, 4bit, 3bit and 2bit uploads avaliable. # Finetune Llama 3.2, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth! We have a free Google Colab Tesla T4 notebook for Llama 3.2 (3B) here: https://colab.research.google.com/drive/1T5-zKWM_5OD21QHwXH…

Side-by-side Specifications

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-ggufunsloth/llama-3.2-3b-instruct-gguf
Authortvall43unsloth
Pipeline Tasktext-generationtext-generation
Librarytransformerstransformers
Downloads20,49046,356
Likes1860
LicenseUnknownUnknown
Context Length
Created2026-03-092024-09-25
Last Modified2026-03-092025-11-08
Tags
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation
transformersggufllamatext-generationllama-3metafacebookunslothenbase_model:meta-llama/Llama-3.2-3B-Instruct

View full details: tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf · unsloth/llama-3.2-3b-instruct-gguf