GraySoft
Model Comparison

thebloke/tinyllama-1.1b-chat-v1.0-ggufvstvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

Side-by-side comparison of thebloke/tinyllama-1.1b-chat-v1.0-gguf and tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf: downloads, license, context length, tasks, and benchmarks.

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

Side-by-side Specifications

thebloke/tinyllama-1.1b-chat-v1.0-gguftvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
AuthorTheBloketvall43
Pipeline Tasktext-generation
Librarytransformerstransformers
Downloads109,45920,490
Likes22018
LicenseUnknownUnknown
Context Length
Created2023-12-312026-03-09
Last Modified2023-12-312026-03-09
Tags
transformersgguftinyllamaendataset:cerebras/SlimPajama-627Bdataset:bigcode/starcoderdatadataset:OpenAssistant/oasst_top1_2023-08-25base_model:TinyLlama/TinyLlama-1.1B-Chat-v1.0base_model:quantized:TinyLlama/TinyLlama-1.1B-Chat-v1.0license:apache-2.0
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation

View full details: thebloke/tinyllama-1.1b-chat-v1.0-gguf · tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf