GraySoft
Model Comparison

maziyarpanahi/wizardlm-2-7b-ggufvstvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

Side-by-side comparison of maziyarpanahi/wizardlm-2-7b-gguf and tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf: downloads, license, context length, tasks, and benchmarks.

maziyarpanahi/wizardlm-2-7b-gguf

MaziyarPanahi · text-generation

pip install llama-cpp-python # With NVidia CUDA acceleration CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python # Or with OpenBLAS acceleration CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install llama-cpp-python # Or with CLBLast acceleration CMAKE_AR…

tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf

tvall43 · text-generation

can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…

Side-by-side Specifications

maziyarpanahi/wizardlm-2-7b-gguftvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
AuthorMaziyarPanahitvall43
Pipeline Tasktext-generationtext-generation
Librarytransformerstransformers
Downloads86,21720,490
Likes8318
LicenseUnknownUnknown
Context Length
Created2024-04-152026-03-09
Last Modified2024-04-152026-03-09
Tags
transformersggufmistralquantized2-bit3-bit4-bit5-bit6-bit8-bit
transformersgguftext-generation-inferenceunslothqwen3_5_moeqwenqwen3.5reasoningchain-of-thoughttext-generation

View full details: maziyarpanahi/wizardlm-2-7b-gguf · tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf