GraySoft
Model Comparison

mlabonne/meta-llama-3.1-8b-instruct-abliterated-ggufvstvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

Side-by-side comparison of mlabonne/meta-llama-3.1-8b-instruct-abliterated-gguf and tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf: downloads, license, context length, tasks, and benchmarks.

mlabonne/meta-llama-3.1-8b-instruct-abliterated-gguf

mlabonne · —

!image/png 🦙 Llama 3.1 70B Instruct lorablated This is an uncensored version of Llama 3.1 8B Instruct created with abliteration (see this article to know more about it). Special thanks to @FailSpy for the original code and technique. Please follow him if you're interested in ab…

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

Side-by-side Specifications

mlabonne/meta-llama-3.1-8b-instruct-abliterated-gguftvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
Authormlabonnetvall43
Pipeline Tasktext-generation
Librarytransformerstransformers
Downloads22,88520,490
Likes17718
LicenseUnknownUnknown
Context Length
Created2024-07-242026-03-09
Last Modified2024-08-032026-03-09
Tags
transformersggufabliterateduncensoredbase_model:meta-llama/Llama-3.1-8B-Instructbase_model:quantized:meta-llama/Llama-3.1-8B-Instructlicense:llama3.1endpoints_compatibleregion:usconversational
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation

View full details: mlabonne/meta-llama-3.1-8b-instruct-abliterated-gguf · tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf