GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

aimeri/spoomplesmaxx-thrasher-24B-i1-GGUF overview

spoomplesmaxx thrasher 24B — i1 GGUF imatrix Weighted/imatrix GGUF quants of spoomplesmaxx thrasher 24B https://huggingface.co/aimeri/spoomplesmaxx thrasher 24…

ggufroleplaycreative-writingchatmltext-generationenbase_model:aimeri/spoomplesmaxx-thrasher-24Bbase_model:quantized:aimeri/spoomplesmaxx-thrasher-24Blicense:apache-2.0endpoints_compatibleregion:usimatrixconversational

Runs locally from ~8.64 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

4 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
spoomplesmaxx-thrasher-24B.i1-IQ3_XXS.ggufGGUFIQ3_XXS8.64 GBDownload
spoomplesmaxx-thrasher-24B.i1-IQ4_XS.ggufGGUFIQ4_XS11.88 GBDownload
spoomplesmaxx-thrasher-24B.i1-Q3_K_M.ggufGGUFQ3_K_M10.69 GBDownload
spoomplesmaxx-thrasher-24B.i1-Q4_K_M.ggufGGUFQ4_K_M13.35 GBDownload

Model Details

Model IDaimeri/spoomplesmaxx-thrasher-24B-i1-GGUF
Authoraimeri
Pipelinetext-generation
Licenseapache-2.0
Base modelaimeri/spoomplesmaxx-thrasher-24B
Last modified2026-08-28T08:54:12.000Z

Model README

---

license: apache-2.0

base_model: aimeri/spoomplesmaxx-thrasher-24B

library_name: gguf

pipeline_tag: text-generation

tags:

- roleplay

- creative-writing

- chatml

language:

- en

---

spoomplesmaxx-thrasher-24B — i1 GGUF (imatrix)

Weighted/imatrix GGUF quants of spoomplesmaxx-thrasher-24B

("Thrash Metal", mimids 02). Calibrated on ~2M chars sampled from the model's own

training corpus (the imatrix.dat is included if you want to cut your own sizes).

ChatML template embedded — llama.cpp picks it up without ceremony.

Prefer these over the static quants

at 3–4 bit; at 5 bit and above the statics are fine.

spoomplesmaxx-thrasher-24B.i1-IQ3_XXS.gguf   ~8.7 GB   smallest usable
spoomplesmaxx-thrasher-24B.i1-Q3_K_M.gguf    ~11 GB    12GB cards
spoomplesmaxx-thrasher-24B.i1-IQ4_XS.gguf    ~12 GB    quality-per-GB pick
spoomplesmaxx-thrasher-24B.i1-Q4_K_M.gguf    ~14 GB    the 24GB-card sweet spot

Sampler (swept on the full-precision model): temperature 1.0 · min_p 0.05.

A mild repetition_penalty 1.05 eliminated the verbatim-loop tail in our sweep at

the cost of a rare unfinished turn — a reasonable opt-in here. See the main card

for the full story: the token surgery that put ChatML on a Mistral base, the

checkpoint-selection battery, and the measured sampler guidance.

For adults. Stays in character by design; bring your own moderation. Apache 2.0.

Run aimeri/spoomplesmaxx-thrasher-24B-i1-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models