GraySoft
Model Comparison

maziyarpanahi/wizardlm-2-7b-ggufvsmradermacher/mn-12b-mag-mell-r1-gguf

Side-by-side comparison of maziyarpanahi/wizardlm-2-7b-gguf and mradermacher/mn-12b-mag-mell-r1-gguf: downloads, license, context length, tasks, and benchmarks.

maziyarpanahi/wizardlm-2-7b-gguf

MaziyarPanahi · text-generation

pip install llama-cpp-python # With NVidia CUDA acceleration CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python # Or with OpenBLAS acceleration CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install llama-cpp-python # Or with CLBLast acceleration CMAKE_AR…

mradermacher/mn-12b-mag-mell-r1-gguf

mradermacher · —

## About static quants of https://huggingface.co/inflatebot/MN-12B-Mag-Mell-R1 weighted/imatrix quants are available at https://huggingface.co/mradermacher/MN-12B-Mag-Mell-R1-i1-GGUF

Side-by-side Specifications

maziyarpanahi/wizardlm-2-7b-ggufmradermacher/mn-12b-mag-mell-r1-gguf
AuthorMaziyarPanahimradermacher
Pipeline Tasktext-generation
Librarytransformerstransformers
Downloads86,21750,033
Likes8347
LicenseUnknownUnknown
Context Length
Created2024-04-152024-09-16
Last Modified2024-04-152024-09-17
Tags
transformersggufmistralquantized2-bit3-bit4-bit5-bit6-bit8-bit
transformersggufmergekitmergeenbase_model:inflatebot/MN-12B-Mag-Mell-R1base_model:quantized:inflatebot/MN-12B-Mag-Mell-R1endpoints_compatibleregion:usconversational

View full details: maziyarpanahi/wizardlm-2-7b-gguf · mradermacher/mn-12b-mag-mell-r1-gguf