MRockatansky/gemma-4-31B-anthology-GGUF overview
<div style="background color: 16171d; color: e2e8f0; padding: 35px; border radius: 12px; font family: system ui, apple system, sans serif;" <div align="center"…
Runs locally from ~13.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| anthology-imatrix.gguf | GGUF | GGUF | 13.1 MB | Download |
| gemma-4-31B-anthology-IQ4_XS.gguf | GGUF | IQ4_XS | 15.59 GB | Download |
| gemma-4-31B-anthology-Q4_K_L.gguf | GGUF | Q4_K_L | 17.72 GB | Download |
| gemma-4-31B-anthology-Q4_K_M.gguf | GGUF | Q4_K_M | 17.40 GB | Download |
| gemma-4-31B-anthology-Q5_K_S.gguf | GGUF | Q5_K_S | 19.85 GB | Download |
| gemma-4-31b-anthology-F16.gguf | GGUF | F16 | 57.20 GB | Download |
| gemma-4-31b-anthology-Q4_X_L.gguf | GGUF | Q4_X_L | 18.96 GB | Download |
| mmproj-anthology-bf16.gguf | GGUF | BF16 | 1.12 GB | Download |
Model Details
| Model ID | MRockatansky/gemma-4-31B-anthology-GGUF |
|---|---|
| Author | MRockatansky |
| Pipeline | — |
| License | apache-2.0 |
| Base model | MRockatansky/gemma-4-31B-anthology |
| Last modified | 2026-07-05T16:27:30.000Z |
Model README
---
license: apache-2.0
base_model: MRockatansky/gemma-4-31B-anthology
quantized_by: MRockatansky
tags:
- merge
- mergekit
- creative-writing
- storytelling
---
<div style="background-color: #16171d; color: #e2e8f0; padding: 35px; border-radius: 12px; font-family: system-ui, -apple-system, sans-serif;">
<div align="center">
<h1>📚 Anthology 31B</h1>
<p><b>Imatrix GGUFs for a Gemma-4-31B merge focused on creative storywriting.</b></p>
<!-- This is the placeholder for your attached repository image -->
<img src="./image.png" alt="Anthology 31B Header Image" width="700px" style="border-radius: 8px; margin: 20px 0; max-width: 100%;">
</div>
---
📌 Overview
Anthology 31B is a creative writing model built via a geometric Model Stock merge of three specialized fine-tunes of gemma-4-31b-it.
Instead of traditional linear weight blending—which can dilute specific behavioral fine-tuning and result in generic text—the Model Stock technique maps the fine-tunes as vectors in a geometric space relative to the base model. This mathematical optimization preserves the distinct literary strengths of each component model rather than averaging them out.
---
🤝 Merged Models
Anthology combines three distinct creative voices to form a singular, cohesive writing instrument:
<table style="width: 100%; border-collapse: collapse; font-size: 0.95rem; margin: 20px 0; background-color: #1e202b; border-radius: 8px; overflow: hidden;">
<thead>
<tr style="background-color: #282a36; text-align: left;">
<th style="padding: 15px; border-bottom: 2px solid #3c3f54;">Component Model</th>
<th style="padding: 15px; border-bottom: 2px solid #3c3f54;">Primary Contribution</th>
</tr>
</thead>
<tbody>
<tr>
<td style="padding: 15px; border-bottom: 1px solid #2d3142;"><a href="https://huggingface.co/MRockatansky/Gemma-4-31B-storymaxxed2" style="color: #a78bfa; font-weight: bold; text-decoration: none;">MRockatansky/Gemma-4-31B-storymaxxed2</a></td>
<td style="padding: 15px; border-bottom: 1px solid #2d3142;">My own tune, which writes great stories from minimal prompting with a writing style close to stock gemma-4, for better or worse.</td>
</tr>
<tr>
<td style="padding: 15px; border-bottom: 1px solid #2d3142;"><a href="https://huggingface.co/nbeerbower/Gemma4-Gutenberg-31B-Heretic" style="color: #a78bfa; font-weight: bold; text-decoration: none;">nbeerbower/Gemma4-Gutenberg-31B-Heretic</a></td>
<td style="padding: 15px; border-bottom: 1px solid #2d3142;">Imbues the output with a classic, novel-like prose structure, and a little dash of antiquated vocabulary from the old public domain fiction it was trained on. </td>
</tr>
<tr>
<td style="padding: 15px; border-bottom: 1px solid #2d3142;"><a href="https://huggingface.co/llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic" style="color: #a78bfa; font-weight: bold; text-decoration: none;">llmfan46/gemma-4-Ortenzya-31B-it-uncensored-heretic</a></td>
<td style="padding: 15px; border-bottom: 1px solid #2d3142;">Chosen for its vocabulary choices and writing style.</td>
</tr>
</tbody>
</table>
---
🛠️ Mergekit Configuration
The merge was conducted utilizing zerofata's gemma4-support branch of Mergekit, using the Model Stock merge method.
merge_method: model_stock
base_model: google/gemma-4-31b-it
dtype: bfloat16
normalize: true
models:
- model: MRockatansky/Gemma-4-31B-storymaxxed2
- model: nbeerbower/Gemma4-Gutenberg-31B-Heretic
- model: llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
---
💜 Special Thanks
- The Beaver AI Discord community: For my introduction to and education in the wonderful world of local open-source AI
- The Tuners: Thanks to nbeerbower and llmfan46 for creating the great models used in this merge
- zerofata: For creating the
gemma4-supportfork of Mergekit that made this merge possible
Run MRockatansky/gemma-4-31B-anthology-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models