GraySoft
Download guIDE →
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

MarsupialAI/Monstral-123B-v2_GGUF overview

iMatrix GGUFs for https://huggingface.co/MarsupialAI/Monstral 123B v2 iMat generated with Kalomaze's groups merged.txt

transformersggufchattext-generationenlicense:otherendpoints_compatibleregion:us

Runs locally from ~9.62 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
63
Likes
3
Pipeline
text-generation
Author
MarsupialAI

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Monstral-123B-v2_Q4km.gguf-00001-of-00002.ggufGGUFQ4KM41.87 GBDownload
Monstral-123B-v2_Q4km.gguf-00002-of-00002.ggufGGUFQ4KM26.32 GBDownload
Monstral-123B-v2_iQ3m.gguf-00002-of-00002.ggufGGUFIQ3M9.62 GBDownload

Model Details

Model IDMarsupialAI/Monstral-123B-v2_GGUF
AuthorMarsupialAI
Pipelinetext-generation
Licenseother
Base model—
Last modified2026-08-30T17:58:46.000Z

Model README

---

license: other

license_name: mrl

language:

  • en

tags:

  • chat

pipeline_tag: text-generation

library_name: transformers

---

iMatrix GGUFs for https://huggingface.co/MarsupialAI/Monstral-123B-v2

iMat generated with Kalomaze's groups_merged.txt

Run MarsupialAI/Monstral-123B-v2_GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models