GraySoft
Model Comparison

mradermacher/trinity-mini-lora-2-i1-ggufvstvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

Side-by-side comparison of mradermacher/trinity-mini-lora-2-i1-gguf and tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf: downloads, license, context length, tasks, and benchmarks.

mradermacher/trinity-mini-lora-2-i1-gguf

mradermacher · —

## About weighted/imatrix quants of https://huggingface.co/NewEden/Trinity-Mini-Lora-2 ***For a convenient overview and download list, visit our model page for this model.*** static quants are available at https://huggingface.co/mradermacher/Trinity-Mini-Lora-2-GGUF

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

Side-by-side Specifications

mradermacher/trinity-mini-lora-2-i1-gguftvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
Authormradermachertvall43
Pipeline Tasktext-generation
Librarytransformerstransformers
Downloads24,32720,490
Likes118
LicenseUnknownUnknown
Context Length
Created2026-03-272026-03-09
Last Modified2026-03-282026-03-09
Tags
transformersgguftrinitymoemerged-loraenbase_model:NewEden/Trinity-Mini-Lora-2base_model:quantized:NewEden/Trinity-Mini-Lora-2license:apache-2.0endpoints_compatible
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation

View full details: mradermacher/trinity-mini-lora-2-i1-gguf · tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf