avar6/minimax-m3-MSA-gguf overview
These are standard llamacpp ggufs with MSA intact. They are experimental and made with a work in progress fork of llamacpp https://github.com/timkhronos/llama.…
Runs locally from ~7.53 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| IQ6_k/minimax-m3-MSA-Q6_K.gguf-00001-of-00008.gguf | GGUF | IQ6_K | 46.13 GB | Download |
| IQ6_k/minimax-m3-MSA-Q6_K.gguf-00002-of-00008.gguf | GGUF | IQ6_K | 45.34 GB | Download |
| IQ6_k/minimax-m3-MSA-Q6_K.gguf-00003-of-00008.gguf | GGUF | IQ6_K | 45.34 GB | Download |
| IQ6_k/minimax-m3-MSA-Q6_K.gguf-00004-of-00008.gguf | GGUF | IQ6_K | 45.34 GB | Download |
| IQ6_k/minimax-m3-MSA-Q6_K.gguf-00005-of-00008.gguf | GGUF | IQ6_K | 45.34 GB | Download |
| IQ6_k/minimax-m3-MSA-Q6_K.gguf-00006-of-00008.gguf | GGUF | IQ6_K | 45.34 GB | Download |
| IQ6_k/minimax-m3-MSA-Q6_K.gguf-00007-of-00008.gguf | GGUF | IQ6_K | 45.34 GB | Download |
| IQ6_k/minimax-m3-MSA-Q6_K.gguf-00008-of-00008.gguf | GGUF | IQ6_K | 7.53 GB | Download |
| Q4_K_M/minimax-m3-MSA-Q4_KM.gguf-00001-of-00006.gguf | GGUF | Q4_K_M | 45.89 GB | Download |
| Q4_K_M/minimax-m3-MSA-Q4_KM.gguf-00002-of-00006.gguf | GGUF | Q4_K_M | 46.38 GB | Download |
| Q4_K_M/minimax-m3-MSA-Q4_KM.gguf-00003-of-00006.gguf | GGUF | Q4_K_M | 45.85 GB | Download |
| Q4_K_M/minimax-m3-MSA-Q4_KM.gguf-00004-of-00006.gguf | GGUF | Q4_K_M | 46.38 GB | Download |
| Q4_K_M/minimax-m3-MSA-Q4_KM.gguf-00005-of-00006.gguf | GGUF | Q4_K_M | 46.17 GB | Download |
| Q4_K_M/minimax-m3-MSA-Q4_KM.gguf-00006-of-00006.gguf | GGUF | Q4_K_M | 8.89 GB | Download |
| Q5_K/minimax-m3-MSA-Q5_K.gguf-00001-of-00007.gguf | GGUF | Q5_K | 45.11 GB | Download |
| Q5_K/minimax-m3-MSA-Q5_K.gguf-00002-of-00007.gguf | GGUF | Q5_K | 45.29 GB | Download |
| Q5_K/minimax-m3-MSA-Q5_K.gguf-00003-of-00007.gguf | GGUF | Q5_K | 45.52 GB | Download |
| Q5_K/minimax-m3-MSA-Q5_K.gguf-00004-of-00007.gguf | GGUF | Q5_K | 45.22 GB | Download |
| Q5_K/minimax-m3-MSA-Q5_K.gguf-00005-of-00007.gguf | GGUF | Q5_K | 45.29 GB | Download |
| Q5_K/minimax-m3-MSA-Q5_K.gguf-00006-of-00007.gguf | GGUF | Q5_K | 44.87 GB | Download |
| Q5_K/minimax-m3-MSA-Q5_K.gguf-00007-of-00007.gguf | GGUF | Q5_K | 10.04 GB | Download |
Model Details
Model README
---
base_model:
- MiniMaxAI/MiniMax-M3
tags:
- gguf
- msa
- minimax-m3
---
These are standard llamacpp ggufs with MSA intact. They are experimental and made with a work in progress fork of llamacpp https://github.com/timkhronos/llama.cpp/tree/MSA. MSA and vision are currently functioning. The vision mmproj can be found here https://huggingface.co/Serpen/Minimax_M3_MMPROJ_GGUF
You can learn more about these ggufs and the fork on the beaver ai discord. We do plan to submit a pull request https://discord.gg/beaverai
Run avar6/minimax-m3-MSA-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models