GraySoft
Model Comparison

hugging-quants/llama-3.2-1b-instruct-q8_0-ggufvstvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

Side-by-side comparison of hugging-quants/llama-3.2-1b-instruct-q8_0-gguf and tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf: downloads, license, context length, tasks, and benchmarks.

hugging-quants/llama-3.2-1b-instruct-q8_0-gguf

hugging-quants · text-generation

This model was converted to GGUF format from meta-llama/Llama-3.2-1B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

Side-by-side Specifications

hugging-quants/llama-3.2-1b-instruct-q8_0-gguftvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
Authorhugging-quantstvall43
Pipeline Tasktext-generationtext-generation
Librarytransformers
Downloads850,44820,490
Likes4618
LicenseUnknownUnknown
Context Length
Created2024-09-252026-03-09
Last Modified2024-09-252026-03-09
Tags
gguffacebookmetapytorchllamallama-3llama-cppgguf-my-repotext-generationen
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation

View full details: hugging-quants/llama-3.2-1b-instruct-q8_0-gguf · tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf