GraySoft
Model Comparison

tetf/gemma-3-1b-it-qat-q4_0-ggufvstvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

Side-by-side comparison of tetf/gemma-3-1b-it-qat-q4_0-gguf and tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf: downloads, license, context length, tasks, and benchmarks.

tetf/gemma-3-1b-it-qat-q4_0-gguf

tetf · text-generation

**Model Page**: Gemma > [!Note] > This repository corresponds to the 1B **instruction-tuned** version of the Gemma 3 model in GGUF format using Quantization Aware Training (QAT). > The GGUF corresponds to Q4_0 quantization. > > Thanks to QAT, the model is able to preserve simila…

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

Side-by-side Specifications

tetf/gemma-3-1b-it-qat-q4_0-gguftvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
Authortetftvall43
Pipeline Tasktext-generationtext-generation
Librarytransformers
Downloads28,50020,490
Likes018
LicenseUnknownUnknown
Context Length
Created2025-04-112026-03-09
Last Modified2025-04-112026-03-09
Tags
ggufgemmagemma3text-generationarxiv:1905.07830arxiv:1905.10044arxiv:1911.11641arxiv:1904.09728arxiv:1705.03551arxiv:1911.01547
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation

View full details: tetf/gemma-3-1b-it-qat-q4_0-gguf · tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf