noctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-ggufvstvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
Side-by-side comparison of noctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-gguf and tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf: downloads, license, context length, tasks, and benchmarks.
noctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-gguf
These are quantizations of the model Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated The imatrix from unsloth has been used for these. Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated Download the latest llama.cpp to use them. Try to use…
tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…
Side-by-side Specifications
| noctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-gguf | tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf | |
|---|---|---|
| Author | noctrex | tvall43 |
| Pipeline Task | image-text-to-text | text-generation |
| Library | — | transformers |
| Downloads | 19,336 | 20,490 |
| Likes | 18 | 18 |
| License | Unknown | Unknown |
| Context Length | — | — |
| Created | 2025-10-22 | 2026-03-09 |
| Last Modified | 2025-11-07 | 2026-03-09 |
| Tags |
View full details: noctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-gguf · tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf