GraySoft
Model Comparison

abiray/gemma-4-e4b-it-heretic-ggufvstvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

Side-by-side comparison of abiray/gemma-4-e4b-it-heretic-gguf and tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf: downloads, license, context length, tasks, and benchmarks.

abiray/gemma-4-e4b-it-heretic-gguf

Abiray · any-to-any

This repository contains GGUF format quantizations of coder3101/gemma-4-E4B-it-heretic.

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

Side-by-side Specifications

abiray/gemma-4-e4b-it-heretic-gguftvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
AuthorAbiraytvall43
Pipeline Taskany-to-anytext-generation
Librarytransformers
Downloads26,78520,490
Likes2818
LicenseUnknownUnknown
Context Length
Created2026-04-032026-03-09
Last Modified2026-04-042026-03-09
Tags
ggufllama-cppgemma-4any-to-anybase_model:coder3101/gemma-4-E4B-it-hereticbase_model:quantized:coder3101/gemma-4-E4B-it-hereticlicense:apache-2.0endpoints_compatibleregion:usimatrix
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation

View full details: abiray/gemma-4-e4b-it-heretic-gguf · tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf