---

language:

- en

license: apache-2.0

library_name: gguf

pipeline_tag: image-text-to-text

base_model: vcruz305/Muse-Glimmer-30B-Hermes-Agentic

base_model_relation: quantized

quantized_by: vcruz305

datasets:

- vcruz305/hermes-agentic-tool-sft

tags:

- gguf

- muse

- muse-glimmer

- hermes-agent

- tool-calling

- agentic

- llama.cpp

---

Model Card for Muse-Glimmer-30B-Hermes-Agentic-GGUF

This is an improved fine-tune of Muse Glimmer 30B for Hermes Agent and other agentic tool work. llama.cpp K-quants of the merged 16-bit student. Start with Q4_K_M on a 24 GB card.

Stock Muse Glimmer already speaks OpenAI-style tools. On hermes-agentic-bench the failure was the opposite of “won’t use tools”: simulated traces hit the consecutive-tool cap with an empty user answer (7/20, 7 HIT_CAP). Inside Hermes the same weights were already better at stopping (native 4/5, mean 2.8 tools). This student is trained to call one or two Hermes-named tools and stop.

I trained it on Unsloth’s free Muse Glimmer Conversational notebook (train docs) on Kaggle 2×T4. The stock notebook is FineTome chat; this run uses vcruz305/hermes-agentic-tool-sft (1,980 rows), apply_chat_template(..., tools=tools), and train_on_responses_only from <|start|>assistant so tool-call turns actually train.

Need llama.cpp ≥ b10353 (#26841). Leave DFlash off when scoring Hermes tool loops.

Model Details

• Developed by: Victor Cruz (vcruz305)
• Base developed by: Meta Superintelligence Lab — Muse Glimmer 30B
• 16-bit merge (full card): vcruz305/Muse-Glimmer-30B-Hermes-Agentic
• License: Apache 2.0
• Language(s): English SFT. Base is multilingual; this mix is English.

Model Sources

• This repo: https://huggingface.co/vcruz305/Muse-Glimmer-30B-Hermes-Agentic-GGUF
• SFT data: https://huggingface.co/datasets/vcruz305/hermes-agentic-tool-sft
• Eval: https://github.com/vcruz305/hermes-agentic-bench
• Train notebook: Unsloth Muse Glimmer Conversational

Why this fine-tune

I run a local Hermes Agent fleet (Telegram, tools, long sessions). Stock Muse is strong at emitting tool calls. The bench failure was loops:

• Open-ended terminal / search traces hit the 12-turn cap with an empty user answer
• Native Hermes was already better at stopping, so the gap was weights + pipe, not “Muse cannot tool-call”
• Community Muse+Hermes reports matched that: loops and unparsed ATEM, not silence

The student: stop after 1–2 Hermes tools, don’t retry a dead tool, recover once from a missing file, don’t invent extra echo hi on “do not use tools.”

Evaluation

Same llama.cpp recipe for stock vs this FT: Q4 class, DFlash off, 32k. Native scores from real hermes chat (footer + session DB).

| Battery | Stock Muse Glimmer | This fine-tune |

|---|---:|---:|

| Simulated hermes_loop_gate.py (20) | 7/20 · mean 5.7 tools · 7 HIT_CAP | 16/20 · mean 1.05 · 0 HIT_CAP |

| Native hermes_native_battery.py | 4/5 · mean 2.8 | 7/7 · mean 1.43 · 0 HIT_CAP |

Native 7/7: web (one search), no-tool math, missing-file stop, list-once, plan-only, no-tool definition, refuse-delete. This is not a re-run of Meta’s MCP Atlas / SWE-Bench table — those stay on the base card. Re-score on your box.

How to Get Started

./llama-cli --version    # need >= b10353

hf download vcruz305/Muse-Glimmer-30B-Hermes-Agentic-GGUF \
  --local-dir Muse-Hermes-GGUF \
  --include "Muse-Glimmer-30B-Hermes-Agentic-Q4_K_M.gguf"

./llama-server \
  -m Muse-Hermes-GGUF/Muse-Glimmer-30B-Hermes-Agentic-Q4_K_M.gguf \
  -a muse-glimmer-30b \
  --host 127.0.0.1 --port 8084 \
  -ngl 99 -c 32768 -np 1 --jinja \
  --temp 0.6 --top-p 0.95 --top-k 64

Hermes provider: http://127.0.0.1:8084/v1, model id muse-glimmer-30b.

| Use | temp | top_p | top_k |

|---|---:|---:|---:|

| Meta default | 1.0 | 0.95 | 64 |

| Hermes loop-gate / this eval | 0.6 | 0.95 | 64 |

Files

| File | Bit class | Start here if |

|---|---|---|

| Muse-Glimmer-30B-Hermes-Agentic-Q4_K_M.gguf | 4 | 24 GB card |

| Muse-Glimmer-30B-Hermes-Agentic-Q5_K_M.gguf | 5 | 24–32 GB |

| Muse-Glimmer-30B-Hermes-Agentic-Q6_K.gguf | 6 | 32 GB+ |

| Muse-Glimmer-30B-Hermes-Agentic-Q8_0.gguf | 8 | near-lossless |

| Muse-Glimmer-30B-Hermes-Agentic-Q3_K_M.gguf | 3 | 16 GB class |

| Muse-Glimmer-30B-Hermes-Agentic-Q2_K.gguf | 2 | smallest usable K-quant |

| Muse-Glimmer-30B-Hermes-Agentic-F16.gguf | 16 | reconvert / research |

Training Details

Unsloth free Muse Conversational notebook, Kaggle 2×T4, QLoRA r=8, 392 steps (1 epoch), loss 0.163, ~3 h 38 m. Dataset vcruz305/hermes-agentic-tool-sft. Full procedure: 16-bit card.

Model Card Authors / Contact

Victor Cruz. This page or https://github.com/vcruz305/hermes-agentic-bench.

Acknowledgements

Meta Superintelligence Lab (Muse Glimmer, Apache 2.0). Unsloth free Muse notebook. Nous Research Hermes Agent.