RobinsonLabs/Qwen3.5-122B-A10B-REAP-20-abliterated-GGUF overview
Qwen3.5 122B A10B REAP 20 Abliterated GGUF Abliterated, importance matrix imatrix quantized GGUFs of 0xSero/Qwen3.5 99B https://huggingface.co/0xSero/Qwen3.5 9…
Runs locally from ~27.51 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ2_M.gguf | GGUF | IQ2_M | 30.53 GB | Download |
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ2_XS.gguf | GGUF | IQ2_XS | 27.51 GB | Download |
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ3_M.gguf | GGUF | IQ3_M | 40.70 GB | Download |
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ3_XS.gguf | GGUF | IQ3_XS | 38.12 GB | Download |
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ4_XS.gguf | GGUF | IQ4_XS | 49.50 GB | Download |
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q3_K_M.gguf | GGUF | Q3_K_M | 44.30 GB | Download |
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q4_K_M.gguf | GGUF | Q4_K_M | 56.06 GB | Download |
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q4_K_S.gguf | GGUF | Q4_K_S | 52.63 GB | Download |
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q5_K_M.gguf | GGUF | Q5_K_M | 65.60 GB | Download |
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q6_K.gguf | GGUF | Q6_K | 75.74 GB | Download |
Model Details
| Model ID | RobinsonLabs/Qwen3.5-122B-A10B-REAP-20-abliterated-GGUF |
|---|---|
| Author | RobinsonLabs |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | 0xSero/Qwen3.5-99B |
| Last modified | 2026-06-29T18:35:20.000Z |
Model README
---
license: apache-2.0
base_model: 0xSero/Qwen3.5-99B
library_name: gguf
pipeline_tag: text-generation
tags:
- gguf
- abliterated
- qwen3.5
- moe
- reap
- not-for-all-audiences
---
Qwen3.5-122B-A10B-REAP-20 - Abliterated GGUF
Abliterated, importance-matrix (imatrix) quantized GGUFs of
0xSero's ~20% MoE expert-prune (REAP) of Qwen/Qwen3.5-122B-A10B,
taking the model from 122B down to ~99B parameters (205 of 256 experts kept) while keeping the A10B
active-expert budget and the qwen35moe architecture. Robinson Labs then abliterated the pruned model
and quantized it here.
This is the lighter-prune sibling of the REAP-30 build:
20% of experts removed instead of 30%, so it keeps more of the original model's capacity at a larger
footprint. Like the REAP-30 variant it has no Multi-Token Prediction (MTP / NextN): the upstream
config declared a phantom nextn layer carrying no weights, so our convert produced a clean 48-layer
model (block_count=48). These are standard single-token-prediction GGUFs.
A full-precision bf16 safetensors base for re-abliteration, LoRA merge, fine-tune, or rolling your own
quants is at RobinsonLabs/Qwen3.5-122B-A10B-REAP-20-abliterated.
Disclosure
This model is abliterated - the hard-refusal reflex on adult / creative content has been reduced
via single-direction weight orthogonalization. Harm guardrails are retained by design: self-harm
prompts still redirect to help (e.g. 988), and it is not intended to assist genuine wrongdoing.
Capability is preserved. Tagged not-for-all-audiences. Use responsibly - you are responsible for
your use. License inherited from the base model: Apache-2.0.
Files
| File | Quant | Size | Notes |
|---|---|---|---|
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q6_K.gguf | Q6_K | 81.3 GB | near-lossless |
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q5_K_M.gguf | Q5_K_M | 70.4 GB | |
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q4_K_M.gguf | Q4_K_M | 60.2 GB | |
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q4_K_S.gguf | Q4_K_S | 56.5 GB | |
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ4_XS.gguf | IQ4_XS | 53.2 GB | quality/size sweet spot |
| Qwen3.5-122B-A10B-REAP-20-abliterated-Q3_K_M.gguf | Q3_K_M | 47.6 GB | |
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ3_M.gguf | IQ3_M | 43.7 GB | |
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ3_XS.gguf | IQ3_XS | 40.9 GB | |
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ2_M.gguf | IQ2_M | 32.8 GB | |
| Qwen3.5-122B-A10B-REAP-20-abliterated-IQ2_XS.gguf | IQ2_XS | 29.5 GB | smallest |
All quants are imatrix-weighted (generic calibration). This is the REAP-pruned 48-layer model - no
MTP block.
!Quant ladder - bits-per-weight vs file size
Method
- Expert prune (REAP): ~20% of the MoE experts removed by 0xSero's REAP method, 122B -> ~99B
params (205 of 256 experts), qwen35moe arch, A10B active budget retained.
- Abliteration: single mid-layer refusal direction removed via weight orthogonalization on the
bf16 pruned base; routers preserved. No MTP/NextN block exists in this variant.
- Quant: importance-matrix (imatrix) weighted convert + quantize with
llama.cpp. The imatrix uses a generic calibration set
(bartowski calibration_datav3) - a broad, domain-agnostic fit.
bf16 base
The full-precision bf16 safetensors base for this ladder is
RobinsonLabs/Qwen3.5-122B-A10B-REAP-20-abliterated
- the master for further surgery (re-abliteration, LoRA merge, fine-tune) and for making your own
quants. The upstream REAP parent is 0xSero/Qwen3.5-99B.
Provenance
Qwen3.5-122B-A10B (Apache-2.0) -> REAP-20 expert-prune (0xSero) -> abliterated bf16 (Robinson Labs)
-> generic-imatrix GGUF quants.
Run RobinsonLabs/Qwen3.5-122B-A10B-REAP-20-abliterated-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models