---

license: mit

license_link: https://huggingface.co/zai-org/GLM-5.2/blob/main/LICENSE

base_model:

- zai-org/GLM-5.2

base_model_relation: quantized

library_name: gguf

pipeline_tag: text-generation

language:

- en

tags:

- gguf

- moe

- mixture-of-experts

- expert-pruning

- compression

- dgx-spark

- gb10

- llama-cpp

- glm

- conversational

model-index:

- name: GLM-5.2-MaxMin108-IQ2_M-fast

results:

- task:

type: text-generation

dataset:

name: MMLU

type: cais/mmlu

metrics:

- type: acc

value: 61.84

name: accuracy (5-shot, generative), IQ2_M-fast file

- task:

type: text-generation

dataset:

name: MBPP

type: google-research-datasets/mbpp

metrics:

- type: pass@1

value: 0.592

name: pass@1 (3-shot, executed), IQ2_M-fast file

---

GLM-5.2 MaxMin108 GGUF

Start here. Use the six IQ2_M-fast shards (95.78 GiB) on a 128 GB machine. MMLU is 61.84 versus 87.29 for the 2-bit parent; expect weaker world knowledge. Details.

<!-- chart:start -->

!GLM-5.2 MaxMin108: MMLU accuracy (%) versus file size. Each point shows a measured file. Exact values are in the comparison tables below.

MMLU point estimates from the comparison table; uncertainty and evaluation settings remain below. The measured reference is Unsloth's 2-bit parent, not BF16. No BF16 or bartowski result is reported. Pruning trades accuracy for size. See How it was tested.

<!-- chart:end -->

Use the exact download command below; automatic variant selection may choose a different file.

hf download turintech/GLM-5.2-MaxMin108-GGUF \
  GLM-5.2-MaxMin108-IQ2_M-fast-00001-of-00006.gguf \
  GLM-5.2-MaxMin108-IQ2_M-fast-00002-of-00006.gguf \
  GLM-5.2-MaxMin108-IQ2_M-fast-00003-of-00006.gguf \
  GLM-5.2-MaxMin108-IQ2_M-fast-00004-of-00006.gguf \
  GLM-5.2-MaxMin108-IQ2_M-fast-00005-of-00006.gguf \
  GLM-5.2-MaxMin108-IQ2_M-fast-00006-of-00006.gguf \
  --local-dir . && \
  llama-server -m GLM-5.2-MaxMin108-IQ2_M-fast-00001-of-00006.gguf \
  --port 8080 --alias glm-5.2-maxmin108 -ngl 99 -fa 1 -ctk q8_0 -ctv q8_0 -c 65536 -np 1 -t 20 --jinja -rea off

The repository also holds the reference file, GLM-5.2-MaxMin108-IQ2_M (six more shards, 100.33 GiB). Download one set,

not both. The Hugging Face file sidebar adds the two sets together and shows them as one "IQ2_M" entry of about 211 GB.

<div>

<a href="https://turintech.ai"><img src="https://huggingface.co/turintech/GLM-5.2-MaxMin108-GGUF/resolve/main/assets/turintech-logo.png" width="180" alt="TurinTech"></a>

<p style="margin: 4px 0;"><em>TurinTech models, built with Artemis</em></p>

</div>

GLM-5.2 is Z.ai's general chat, code and reasoning model. This is an expert-pruned version

of Unsloth's 2-bit GGUF of it: the experts kept are byte-identical copies, the rest are removed. English only.

This is an independent TurinTech release, not affiliated with or endorsed by Z.ai or Unsloth.

Ollama: no verified supported package is provided here. Use the exact llama.cpp command above; an automatic integration button is not a compatibility test.

Why use this file

• Run locally so inputs can stay on the same machine.
• Work offline after downloading the model and runtime.
• Use for local chat, summaries and code assistance.
• Run the pruned GLM model on the single-machine configurations documented below, with the stated accuracy trade-offs.

Files

| Variant | Size | Saved | MMLU | MBPP pass@1 | Choose for |

| --- | --- | --- | --- | --- | --- |

| 2-bit parent | 222.18 GiB | | 87.29 | 0.710 | |

| IQ2_M-fast | 95.78 GiB | 57% | 61.84 | 0.592 | Default. |

| IQ2_M | 100.33 GiB | 55% | 63.00 | 0.626 | More capable. |

“Saved” is the file-size reduction versus the 2-bit parent.

IQ2_M-fast: Default. Smaller, frees about 5 GB.

IQ2_M: The reference file used for the detailed measurements below.

Both keep the same 108 experts per layer, byte-identical; they differ only in the precision of the non-expert

tensors. Each is a set of six shards: GLM-5.2-MaxMin108-IQ2_M-fast-0000N-of-00006.gguf for the default and

GLM-5.2-MaxMin108-IQ2_M-0000N-of-00006.gguf for the reference. Download one set. To get the reference instead:

hf download turintech/GLM-5.2-MaxMin108-GGUF --include "GLM-5.2-MaxMin108-IQ2_M-0000*" --local-dir .

The closest public alternative, REAP-50 Q3_K_M

(169.30 GiB), scores 62.75 on MMLU against 63.00 for the reference file and is ahead on code (0.708), but does not fit

a 128 GB machine.

Run it

llama-server -m GLM-5.2-MaxMin108-IQ2_M-fast-00001-of-00006.gguf --port 8080 \
  --alias glm-5.2-maxmin108 -ngl 99 -fa 1 -ctk q8_0 -ctv q8_0 \
  -c 65536 -np 1 -t 20 --jinja -rea off

-rea off is recommended: without it, GLM-5.2's template emits a high reasoning-effort

directive that can consume an entire short generation budget on hidden reasoning tokens.

Requires llama.cpp with GLM-DSA support (build b10005 / 7f575c39d or newer).

Questions, problems or a model to consider for a smaller version? Reply in our feedback thread.

<a id="benchmarks"></a>

<details>

<summary>Evaluation details and limitations</summary>

How it was tested

Recommendation notes

Start here. Download the six GLM-5.2-MaxMin108-IQ2_M-fast shards (95.78 GiB in total) and start llama-server on

shard 00001 with the command in Run it; llama.cpp finds the rest. It needs a 128 GB machine: on one NVIDIA

GB10 (DGX Spark) it used 104 of 121 GB at a 64K context. It scores 61.84 on MMLU against 87.29 for the 2-bit parent,

so expect much weaker world knowledge.

Use the exact IQ2_M-fast shard pattern below for the recommended build. Both builds share the IQ2_M label, so selecting that label alone does not identify a unique shard set.

Size and quality trade-offs

zai-org/GLM-5.2 is a 753B

mixture-of-experts model. Unsloth's public 2-bit GGUF (UD-IQ2_M) is 222 GiB, so it needs a

multi-GPU server. This file keeps 108 of the 256 experts in each layer and is 95.8 GiB, 57% smaller than that 2-bit

file, so it runs on a single 128 GB desktop (one NVIDIA GB10 / DGX Spark). The cost is real: it scores 61.8 on MMLU

against 87.3 for the parent, and 0.59 against 0.71 on MBPP. Use it when a task needs GLM-5.2 on one machine; if a

120B-class model fits the target hardware, that will likely score higher.

Everything below was run by us, in the same harnesses, for all four models, including the parent and the

comparator. Nothing is quoted from another card.

MMLU: lm-evaluation-harness mmlu_generative, 5-shot, all 14,042 questions

| model | size | MMLU | humanities | social sci. | STEM | other |

|---|---:|---:|---:|---:|---:|---:|

| GLM-5.2 UD-IQ2_M (parent) | 222.18 GiB | 87.29 ±0.27 | 83.44 | 91.84 | 87.03 | 88.86 |

| REAP-50 Q3_K_M (comparator) | 169.30 GiB | 62.75 ±0.39 | 63.63 | 66.85 | 62.26 | 57.84 |

| MaxMin108 | 100.33 GiB | 63.00 ±0.39 | 62.74 | 68.61 | 59.25 | 61.67 |

| MaxMin108-fast | 95.78 GiB | 61.84 ±0.40 | 62.64 | 67.57 | 57.82 | 59.06 |

MaxMin108 and REAP-50 differ by 0.25 MMLU points, with reported error bars of ±0.39. This does not establish equivalence. REAP-50 scores higher on STEM (+3.01) and humanities (+0.89). The table reports social sciences and other-category scores for both files. REAP-50 uses 3.82 bpw and 128 experts, compared with 2.65 bpw and 108 experts for MaxMin108.

MBPP: 3-shot, 500 problems, pass@1, code executed

| model | size | pass@1 | retained vs parent |

|---|---:|---:|---:|

| parent | 222.18 GiB | 0.710 ±0.020 | |

| REAP-50 Q3_K_M | 169.30 GiB | 0.708 ±0.020 | 99.7% |

| MaxMin108 | 100.33 GiB | 0.626 ±0.022 | 88.2% |

| MaxMin108-fast | 95.78 GiB | 0.592 ±0.022 | 83.4% |

REAP-50 is statistically indistinguishable from the parent on MBPP (0.708 vs 0.710) while losing 24.54 MMLU points. Pruning half the experts costs almost

nothing on short-form code generation and roughly a quarter of world knowledge. That

dissociation, where expert pruning destroys knowledge far faster than procedural coding

ability, is the most transferable result here, and it holds for our artifact too: MaxMin108

retains 88.2% of parent MBPP against only 72.2% of parent MMLU.

MaxMin108 is genuinely behind REAP-50 on MBPP by 8.2 points, about 2.8 sigma. The MMLU comparison does not establish equivalence.

Generation quality: 13 frozen prompts, greedy decoding

Degeneration is scored objectively: 4-gram distinctness below 0.55, a line repeated 4 or more

times, or a word repeated 5 or more times consecutively.

| model | in-domain | out-of-domain | OOD distinct-4 |

|---|---|---|---|

| parent | 0/8 | 0/5 | 0.991 |

| REAP-50 Q3_K_M | 0/8 | 1/5 | 0.883 |

| MaxMin108 | 0/8 | 0/5 | 0.855 (0.996 sampled) |

| MaxMin108-fast | 0/8 | 0/5 | 0.984 |

At greedy decoding, both artifacts here produced zero degenerate outputs across the thirteen tested prompts. This small sample does not establish reliability on other prompts.

</details>

Memory

Resident memory at a 64K context (-c 65536 -np 1 --jinja -rea off) on one NVIDIA GB10 (DGX Spark, 128 GB unified):

GLM-5.2-MaxMin108-IQ2_M 109 of 121 GB, GLM-5.2-MaxMin108-IQ2_M-fast 104 of 121 GB. The parent and REAP-50 do not

fit on this machine.

<details>

<summary>File sizes and SHA-256 checksums</summary>

File checksums

SHA-256 and exact byte sizes for the published shards. Download all six shards of one build. The reference set totals 107,725,462,368 bytes (100.33 GiB); the fast set totals 102,844,865,312 bytes (95.78 GiB).

| File | Bytes | SHA-256 |

|---|---:|---|

| GLM-5.2-MaxMin108-IQ2_M-00001-of-00006.gguf | 19,919,123,520 | d0178270a952acce4604c0b0d0927b0880ebafd536b4d3b9ba235ded61ede771 |

| GLM-5.2-MaxMin108-IQ2_M-00002-of-00006.gguf | 19,887,158,176 | 9f92763d5b17461a7dfc35610cd9c8fa0ff1aea6946c0a51b35ee4c3c5b02e9e |

| GLM-5.2-MaxMin108-IQ2_M-00003-of-00006.gguf | 19,983,352,352 | 3325956d21fd10570f670a87dbb60edc0d858f41bbacffd91dd1e17dbea8bb28 |

| GLM-5.2-MaxMin108-IQ2_M-00004-of-00006.gguf | 19,570,038,016 | b45b098f89d0b835d281b60237175c4218fd4226e1f35e9c310f2ce06cc2a7f9 |

| GLM-5.2-MaxMin108-IQ2_M-00005-of-00006.gguf | 19,525,472,928 | 1102d11c59d75de77212796af30c15324c6d3fa08c7ffbe777105c750339bbb8 |

| GLM-5.2-MaxMin108-IQ2_M-00006-of-00006.gguf | 8,840,317,376 | 98ad228aab76b5ec13f301bec62105115b6f6612c918478cfd17df78daa72e33 |

| GLM-5.2-MaxMin108-IQ2_M-fast-00001-of-00006.gguf | 19,647,907,648 | 474e56459dbcd4d24724c5d4f17134f9249d240b6fa10f4858c15424ac8ced6b |

| GLM-5.2-MaxMin108-IQ2_M-fast-00002-of-00006.gguf | 19,996,222,432 | c0cd3e8b744f3f7cb0ed474947399d9c7ae8f4f92e056b583fbef63a7f0ff8a8 |

| GLM-5.2-MaxMin108-IQ2_M-fast-00003-of-00006.gguf | 19,983,115,744 | 55225dabc4949644fe438422098c9fa9fb20a5484c33a8f273abfe86f842e01c |

| GLM-5.2-MaxMin108-IQ2_M-fast-00004-of-00006.gguf | 19,994,903,968 | 4cd8d0351b906e841d627421c04bc90b2da518b9ae218896bf443beedafb496b |

| GLM-5.2-MaxMin108-IQ2_M-fast-00005-of-00006.gguf | 19,786,045,216 | 00b228beb6ab6196036e07f06d24828700a8e1c3b0c92f47ee46ecf895b9b3be |

| GLM-5.2-MaxMin108-IQ2_M-fast-00006-of-00006.gguf | 3,436,670,304 | 4e00d07fae36b35d7cb2f4e764b54f03f25f010d009c5285dff86bf61defa09b |

</details>

What is in the files

108 of the 256 routed experts per layer are kept, and they are byte-identical copies of Unsloth's UD-IQ2_M tensors;

nothing in them is requantised. The -fast variant also stores the non-expert tensors at lower precision.

Known costs

• World knowledge is substantially reduced. On MMLU the default -fast file scores 61.84 and the reference file

63.00, against 87.29 for the parent. Answers

can be fluent and confidently wrong. In our 13-prompt test neither file looped, which can make

the remaining errors harder to spot.

• English only. GLM-5.2 is bilingual (en/zh); this release was built and tested in

English only. Chinese was not evaluated.

• Code is behind REAP-50. MBPP pass@1 is 0.592 for the default -fast file and 0.626 for the reference file,

against 0.708 for REAP-50.

• Derived from an IQ2_M quantisation, not BF16. All figures isolate the cost of pruning

on top of quantisation; quantisation's own cost is not measured here.

• Two benchmarks. We attempted IFEval for instruction-following on two separate occasions

and could not complete it: llama.cpp's server strictly parses model output against the

template's declared reasoning and tool-call grammars, returning HTTP 500 on a parse failure.

Roughly 1 to 4% of IFEval prompts triggered this on the pruned models across four server

configurations, while the parent never did. That the compressed models occasionally emit

unparseable structured output is itself a compression artifact, and one we would rather

report than hide.

• Sampled decoding (--temp 0.6 --top-p 0.95) produces noticeably better output than greedy,

so the greedy numbers above are a deliberately conservative floor.

Credits

This work rests on three others and would not exist without them:

• zai-org/GLM-5.2, the base model (MIT).
• unsloth/GLM-5.2-GGUF, the UD-IQ2_M

quantisation these artifacts are sliced from. Every expert tensor here is a byte-identical

copy of theirs, the released files still carry their importance-matrix metadata, and their

dynamic-quantisation choices, meaning which tensors to protect at higher precision, are

inherited wholesale.

• Cerebras REAP (ICLR 2026), the expert-pruning

research this release builds on.

• pipenetwork/GLM-5.2-REAP50-Q3_K_M-GGUF,

the comparator, and the reason a meaningful baseline existed to measure against. Its

numbers here were measured by us; see that repository for its own licence and terms.

Custom versions

We also make fine-tuned and further optimised versions on request: tuned on specific data, built for the target hardware

(CPU servers, laptops, Apple Silicon, edge devices), or compressed from a private model.

Book a call with TurinTech.

Licence

MIT, the same as zai-org/GLM-5.2; see LICENSE and NOTICE.

When serving these files to others, for example through an API, an inference provider or OpenRouter, we'd

appreciate a mention of TurinTech (turintech.ai) as the source.

These files keep improving.