GLM-5.3-Flash-PaoAI-ROCmFP4-STRIX-BALANCED-GGUF

The balanced GLM-5.3-Flash quant for AMD Strix Halo (Ryzen AI Max+ 395 / gfx1151). Measured, not marketed: loads on ONE Strix Halo box with zero special accommodations — the smallest file (71.8 GiB) and the no-fuss daily driver.

Brand: PaoAI · community quant, not affiliated with Z.AI.

---

What is this? (30 seconds)

We took the 642 GB GLM-5.3-Flash and compressed it organ by organ: the parts that need precision keep it, the parts that don't get compressed harder. The BALANCED mix stays small enough for one box with no offload flags.

The recipe (what's inside)

| Model part | What it does | Format |

|---|---|---|

| 👁 Attention (attn, indexer) | reads your prompt, tracks context | Q3_K (~3.4 bpw) |

| 🧠 Experts (FFN MoE) | the knowledge (most of the size) | IQ1_M (~1.75 bpw, imatrix) |

| ✍️ Draft head (blk.45) | MTP speculative guessing | Q6_K (~6.6 bpw) |

| 📡 Router, glue, norms | keep signals correct | FP32 (never touched) |

Chain-test results (N=3 medians — Sep 2026)

We run a fixed coding exam ("chain test") where tasks are graded by execution, not opinion: the model reads deceptive code and must trace it, implements a novel state machine, and writes a thread-safe ring buffer that survives a 5,000-operation stress harness. Three identical runs per model; we report medians with spreads (identical runs vary — single scores are unreliable).

| Task (what it measures) | Median of 3 | Runs |

|---|---|---|

| Automaton — implement novel rules + exact state trace | 100 | 100 · 100 · 40 |

| Hunt — read lying code: trace it + find the planted bug | 60 | 60 · 100 · 60 |

| Ring buffer — multi-threaded code under stress | 20 | 20 · 20 · 100 |

Task median: 67/100 (runs 60 · 73 · 67)

Plain read: novel-algorithm implementation is reliable (100 median). Multi-threaded code is the known weak spot — for concurrency tasks, generate → run the tests → regenerate once if needed.

Speed (decode, tokens/second, per phase)

| Phase | t/s (3-run range) |

|---|---|

| Spec (planning) | 11.0 – 13.7 |

| Hunt (analysis) | 14.5 – 15.5 |

| Automaton (code writing) | 15.7 – 18.2 ← fastest sustained code output of our builds |

| Ring buffer (code writing) | 10.2 – 12.5 |

| Publish (long output) | 10.3 – 10.7 — filled the full 12,000-token budget every run |

Facts

| Metric | Result |

|---|---|

| File size | 71.8 GiB (single file) |

| Load | full GPU, no special flags needed |

| Context | tested at 64K (-c 65536) |

| Served with | MTP speculative decoding (n-max 4), flash attention, KV q8_0 |

Requirements — which llama.cpp build

This model uses two things stock llama.cpp doesn't have:

• the glm5next architecture (GLM-5.3-Flash)
• the Q4_0_ROCMFP4_FAST quant type (type 101 — ROCm FP4, gfx1151-native)

Both live in kingjones30/ROCmFPX, branch main, commit 3345156 or later (the glm5next merge). Tested with GGML_VULKAN=ON on Strix Halo (gfx1151).

If you build from the wrong tree you'll see exactly one of these:

| Build | Error |

|---|---|

| stock llama.cpp | unknown model architecture: 'glm5next' |

| Unsloth's glm5next branch | invalid ggml type 101. should be in [0, 43) |

How to run (measured, locked)

llama-server -m GLM-5.3-Flash-PaoAI-ROCmFP4-STRIX-BALANCED.gguf \
  --host 0.0.0.0 --port 8080 -ngl 999 -c 65536 --parallel 1 \
  --spec-type draft-mtp --spec-draft-n-max 4 \
  -fa on --cache-type-k q8_0 --cache-type-v q8_0 --lazy-mode off

Add --path <webui assets> if your build serves the WebUI from disk.

Known limits (honest)

• Threading code: ring-buffer implementations crash or deadlock in most chain runs (median 20). Single-threaded generation is strong. Regenerate-once guidance above.
• Long thinking: GLM-5.3-Flash reasons heavily; give it generous token budgets for complex tasks or answers get cut mid-thought
• Driver wall (Strix Halo): Vulkan single allocations near ~98GB can wedge the GPU (needs reboot) — this model at 71.8 GiB is safely under, but don't merge shards into one file

Credits & license

• Z.AI — GLM-5.3-Flash base model (MIT license; included in repo)
• Unsloth — BF16 source + imatrix
• kingjones30 / charlie12345 — ROCmFPX format & recipes
• ggml-org — llama.cpp
• PaoAI — glm5next port, hybrid recipe, fleet benchmarking, chain test

MIT, same as the base model. Not affiliated with Z.AI.