GraySoft
Download guIDE →
Model Comparison

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-ggufvsunsloth/qwen3-4b-instruct-2507-gguf

Side-by-side comparison of tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf and unsloth/qwen3-4b-instruct-2507-gguf: downloads, license, context length, tasks, and benchmarks.

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

unsloth/qwen3-4b-instruct-2507-gguf

unsloth · —

Side-by-side Specifications

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-ggufunsloth/qwen3-4b-instruct-2507-gguf
Authortvall43unsloth
Pipeline Tasktext-generation—
Librarytransformerstransformers
Downloads20,49060,797
Likes18170
LicenseUnknownUnknown
Context Length——
Created2026-03-092025-08-06
Last Modified2026-03-092025-08-20
Tags
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation
transformersggufqwenqwen3unslotharxiv:2505.09388base_model:Qwen/Qwen3-4B-Instruct-2507base_model:quantized:Qwen/Qwen3-4B-Instruct-2507license:apache-2.0endpoints_compatible

View full details: tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf · unsloth/qwen3-4b-instruct-2507-gguf