GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

zTrojan/Qwen3.5-122B-A10B-REAP30-APEX-GGUF overview

Qwen3.5 122B A10B REAP30 APEX GGUF Physical REAP30 pruned APEX GGUF builds of Qwen/Qwen3.5 122B A10B . Available quants | File | Description | | | | | Qwen3.5 …

llama.cppggufqwenqwen3.5moereapreap30apexapex-miniapex-quantquantizedtext-generationenukbase_model:Qwen/Qwen3.5-122B-A10Bbase_model:quantized:Qwen/Qwen3.5-122B-A10Blicense:otherendpoints_compatibleregion:usimatrixconversational

Runs locally from ~30.75 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.5-122B-A10B-REAP30-APEX-Mini.ggufGGUFGGUF30.75 GBDownload

Model Details

Model IDzTrojan/Qwen3.5-122B-A10B-REAP30-APEX-GGUF
AuthorzTrojan
Pipelinetext-generation
Licenseother
Base modelQwen/Qwen3.5-122B-A10B
Last modified2026-06-12T10:12:26.000Z

Model README

---

license: other

base_model: Qwen/Qwen3.5-122B-A10B

language:

  • en
  • uk

library_name: llama.cpp

pipeline_tag: text-generation

tags:

  • gguf
  • qwen
  • qwen3.5
  • moe
  • reap
  • reap30
  • apex
  • apex-mini
  • apex-quant
  • llama.cpp
  • quantized

---

Qwen3.5-122B-A10B REAP30 APEX GGUF

Physical REAP30-pruned APEX GGUF builds of Qwen/Qwen3.5-122B-A10B.

Available quants

| File | Description |

|---|---|

| Qwen3.5-122B-A10B-REAP30-APEX-Mini.gguf | Production APEX Mini quant with imatrix |

REAP pruning

  • Method: physical REAP expert pruning
  • Compression ratio: 30%
  • Original experts per MoE layer: 256
  • Retained experts per MoE layer: 180
  • Layers: 48
  • Experts per token: 8
  • Observation: 32 batches
  • Distance: cosine
  • Seed: 42
  • Calibration source: custom calibration-v2

APEX Mini quantization

  • Tensor config: configs/qwen35_122b_mini.txt
  • Base fallback type: Q3_K_M
  • Imatrix context: -c 4096
  • Imatrix chunks: --chunks 128
  • Imatrix calibration: 64MB shuffled calibration-v2
  • Imatrix model source: REAP30 BF16 GGUF
  • Text-only GGUF: MTP disabled before conversion

The Mini profile uses Q3_K edge experts and IQ2_S middle routed experts, so imatrix is required.

Example: llama.cpp

llama-cli \
  -m Qwen3.5-122B-A10B-REAP30-APEX-Mini.gguf \
  -p "<|im_start|>user
Привіт. Напиши один короткий параграф українською. /no_think
<|im_end|>
<|im_start|>assistant
" \
  -n 128 \
  -c 4096 \
  -ngl 40 \
  --temp 0.6 \
  --top-p 0.95
Notes

Experimental physical expert-pruned build for testing and comparison with REAP20/REAP40 variants.

Run zTrojan/Qwen3.5-122B-A10B-REAP30-APEX-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models