GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

MRockatansky/gemma-4-31B-anthology-GGUF overview

<div style="background color: 16171d; color: e2e8f0; padding: 35px; border radius: 12px; font family: system ui, apple system, sans serif;" <div align="center"…

ggufmergemergekitcreative-writingstorytellingbase_model:MRockatansky/gemma-4-31B-anthologybase_model:quantized:MRockatansky/gemma-4-31B-anthologylicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~13.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
363
Likes
1
Pipeline

Repository Files & Downloads

8 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
anthology-imatrix.ggufGGUFGGUF13.1 MBDownload
gemma-4-31B-anthology-IQ4_XS.ggufGGUFIQ4_XS15.59 GBDownload
gemma-4-31B-anthology-Q4_K_L.ggufGGUFQ4_K_L17.72 GBDownload
gemma-4-31B-anthology-Q4_K_M.ggufGGUFQ4_K_M17.40 GBDownload
gemma-4-31B-anthology-Q5_K_S.ggufGGUFQ5_K_S19.85 GBDownload
gemma-4-31b-anthology-F16.ggufGGUFF1657.20 GBDownload
gemma-4-31b-anthology-Q4_X_L.ggufGGUFQ4_X_L18.96 GBDownload
mmproj-anthology-bf16.ggufGGUFBF161.12 GBDownload

Model Details

Model IDMRockatansky/gemma-4-31B-anthology-GGUF
AuthorMRockatansky
Pipeline
Licenseapache-2.0
Base modelMRockatansky/gemma-4-31B-anthology
Last modified2026-07-05T16:27:30.000Z

Model README

---

license: apache-2.0

base_model: MRockatansky/gemma-4-31B-anthology

quantized_by: MRockatansky

tags:

  • merge
  • mergekit
  • creative-writing
  • storytelling

---

<div style="background-color: #16171d; color: #e2e8f0; padding: 35px; border-radius: 12px; font-family: system-ui, -apple-system, sans-serif;">

<div align="center">

<h1>📚 Anthology 31B</h1>

<p><b>Imatrix GGUFs for a Gemma-4-31B merge focused on creative storywriting.</b></p>

<!-- This is the placeholder for your attached repository image -->

<img src="./image.png" alt="Anthology 31B Header Image" width="700px" style="border-radius: 8px; margin: 20px 0; max-width: 100%;">

</div>

---

📌 Overview

Anthology 31B is a creative writing model built via a geometric Model Stock merge of three specialized fine-tunes of gemma-4-31b-it.

Instead of traditional linear weight blending—which can dilute specific behavioral fine-tuning and result in generic text—the Model Stock technique maps the fine-tunes as vectors in a geometric space relative to the base model. This mathematical optimization preserves the distinct literary strengths of each component model rather than averaging them out.

---

🤝 Merged Models

Anthology combines three distinct creative voices to form a singular, cohesive writing instrument:

<table style="width: 100%; border-collapse: collapse; font-size: 0.95rem; margin: 20px 0; background-color: #1e202b; border-radius: 8px; overflow: hidden;">

<thead>

<tr style="background-color: #282a36; text-align: left;">

<th style="padding: 15px; border-bottom: 2px solid #3c3f54;">Component Model</th>

<th style="padding: 15px; border-bottom: 2px solid #3c3f54;">Primary Contribution</th>

</tr>

</thead>

<tbody>

<tr>

<td style="padding: 15px; border-bottom: 1px solid #2d3142;"><a href="https://huggingface.co/MRockatansky/Gemma-4-31B-storymaxxed2" style="color: #a78bfa; font-weight: bold; text-decoration: none;">MRockatansky/Gemma-4-31B-storymaxxed2</a></td>

<td style="padding: 15px; border-bottom: 1px solid #2d3142;">My own tune, which writes great stories from minimal prompting with a writing style close to stock gemma-4, for better or worse.</td>

</tr>

<tr>

<td style="padding: 15px; border-bottom: 1px solid #2d3142;"><a href="https://huggingface.co/nbeerbower/Gemma4-Gutenberg-31B-Heretic" style="color: #a78bfa; font-weight: bold; text-decoration: none;">nbeerbower/Gemma4-Gutenberg-31B-Heretic</a></td>

<td style="padding: 15px; border-bottom: 1px solid #2d3142;">Imbues the output with a classic, novel-like prose structure, and a little dash of antiquated vocabulary from the old public domain fiction it was trained on. </td>

</tr>

<tr>

<td style="padding: 15px; border-bottom: 1px solid #2d3142;"><a href="https://huggingface.co/llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic" style="color: #a78bfa; font-weight: bold; text-decoration: none;">llmfan46/gemma-4-Ortenzya-31B-it-uncensored-heretic</a></td>

<td style="padding: 15px; border-bottom: 1px solid #2d3142;">Chosen for its vocabulary choices and writing style.</td>

</tr>

</tbody>

</table>

---

🛠️ Mergekit Configuration

The merge was conducted utilizing zerofata's gemma4-support branch of Mergekit, using the Model Stock merge method.

merge_method: model_stock
base_model: google/gemma-4-31b-it
dtype: bfloat16
normalize: true
models:
  - model: MRockatansky/Gemma-4-31B-storymaxxed2
  - model: nbeerbower/Gemma4-Gutenberg-31B-Heretic
  - model: llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic

---

💜 Special Thanks

  • The Beaver AI Discord community: For my introduction to and education in the wonderful world of local open-source AI
  • The Tuners: Thanks to nbeerbower and llmfan46 for creating the great models used in this merge
  • zerofata: For creating the gemma4-support fork of Mergekit that made this merge possible

Run MRockatansky/gemma-4-31B-anthology-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models