GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

MarsupialAI/Monstral-123B_iMat_GGUF overview

iMatrix GGUFs for https://huggingface.co/MarsupialAI/Monstral 123B iMat generated using Kalomaze's groups merged.txt

transformersggufchatrperptext-generationenlicense:otherendpoints_compatibleregion:usimatrixconversational

Runs locally from ~26.32 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).

Downloads
21
Likes
2
Pipeline
text-generation

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
monstral_Q4km.gguf-00001-of-00002.ggufGGUFQ4KM41.87 GBDownload
monstral_Q4km.gguf-00002-of-00002.ggufGGUFQ4KM26.32 GBDownload

Model Details

Model IDMarsupialAI/Monstral-123B_iMat_GGUF
AuthorMarsupialAI
Pipelinetext-generation
Licenseother
Base model
Last modified2026-08-30T17:57:04.000Z

Model README

---

license: other

license_name: mrl

language:

  • en

tags:

  • chat
  • rp
  • erp

pipeline_tag: text-generation

library_name: transformers

---

iMatrix GGUFs for https://huggingface.co/MarsupialAI/Monstral-123B

iMat generated using Kalomaze's groups_merged.txt

Run MarsupialAI/Monstral-123B_iMat_GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models