GraySoft
Download guIDE →
Model Comparison

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-ggufvsunsloth/gemma-4-31b-it-gguf

Side-by-side comparison of tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf and unsloth/gemma-4-31b-it-gguf: downloads, license, context length, tasks, and benchmarks.

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

unsloth/gemma-4-31b-it-gguf

unsloth · image-text-to-text

processor = AutoProcessor.from_pretrained(MODEL_ID) model = AutoModelForCausalLM.from_pretrained( MODEL_ID, dtype="auto", device_map="auto" ) `` Once the model is loaded, you can start generating output: `python # Prompt messages = [ {"role": "system", "content": "You are a help…

Side-by-side Specifications

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-ggufunsloth/gemma-4-31b-it-gguf
Authortvall43unsloth
Pipeline Tasktext-generationimage-text-to-text
Librarytransformers—
Downloads20,4901,362,626
Likes18325
LicenseUnknownUnknown
Context Length——
Created2026-03-092026-04-01
Last Modified2026-03-092026-04-11
Tags
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation
ggufgemma4unslothgemmagoogleimage-text-to-textbase_model:google/gemma-4-31B-itbase_model:quantized:google/gemma-4-31B-itlicense:apache-2.0endpoints_compatible

View full details: tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf · unsloth/gemma-4-31b-it-gguf