GraySoft
Model Comparison

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-ggufvsunsloth/smollm2-135m-instruct-gguf

Side-by-side comparison of tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf and unsloth/smollm2-135m-instruct-gguf: downloads, license, context length, tasks, and benchmarks.

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

unsloth/smollm2-135m-instruct-gguf

unsloth · —

We have a free Google Colab Tesla T4 notebook for Llama 3.2 (3B) here: https://colab.research.google.com/drive/1Ys44kVvmeZtnICzWz0xgpRnrIOjZAuxp?usp=sharing # unsloth/SmolLM2-135M-Instruct-GGUF For more details on the model, please go to Hugging Face's original model card

Side-by-side Specifications

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-ggufunsloth/smollm2-135m-instruct-gguf
Authortvall43unsloth
Pipeline Tasktext-generation
Librarytransformerstransformers
Downloads20,49025,798
Likes1819
LicenseUnknownUnknown
Context Length
Created2026-03-092024-10-31
Last Modified2026-03-092024-10-31
Tags
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation
transformersggufllamaunslothenbase_model:HuggingFaceTB/SmolLM2-135M-Instructbase_model:quantized:HuggingFaceTB/SmolLM2-135M-Instructlicense:apache-2.0endpoints_compatibleregion:us

View full details: tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf · unsloth/smollm2-135m-instruct-gguf