poisonxa/PXA-Fusion-122B-A5B-GGUF overview
PXA Fusion 122B A5B banner.png PXA Fusion 122B A5B GGUF 122B MoE A5B, top 4 active · qwen35moe · MTP speculative decode · 256K context · vanilla PXQ quants for…
Runs locally from ~22.12 GB disk (24 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| PXA-Fusion-122B-A5B-PXQ2.gguf | GGUF | GGUF | 34.59 GB | Download |
| PXA-Fusion-122B-A5B-PXQ4.gguf | GGUF | GGUF | 62.15 GB | Download |
| PXA-Fusion-122B-A5B-PXQ6.gguf | GGUF | GGUF | 65.60 GB | Download |
| PXA-Fusion-122B-A5B-PXQU24.gguf | GGUF | GGUF | 22.12 GB | Download |
| PXA-Fusion-122B-A5B-PXQU32.gguf | GGUF | GGUF | 30.09 GB | Download |
| PXA-Fusion-122B-A5B-PXQU48.gguf | GGUF | GGUF | 45.27 GB | Download |
Model Details
Model README
PXA-Fusion-122B-A5B-GGUF
122B MoE (A5B, top-4 active) · qwen35moe · MTP speculative decode · 256K context · vanilla PXQ quants for salvaged Pascal / Volta silicon.
Runs on old cheap datacenter cards (P100 / V100) via the PXA pxq_llama fork.
> ## Re-download if you pulled before 2026-07-25 - chat template fixed
>
> All six quants shipped a chat template with an inverted enable_thinking default. Unless your client
> explicitly sent enable_thinking:false, the template pre-filled an unclosed <think> tag, so generation
> began inside an unbounded reasoning channel. In agentic and coding harnesses this looks like the model
> planning forever - long first-person prose, no tool calls, no files written.
>
> Fixed in place on 2026-07-25. The patch rewrites only the template metadata; the weights are byte-identical
> (every file was sha256-verified against the published copy before patching, and the patch preserves byte
> length). Re-pull just the .gguf you use.
>
> Note for llama.cpp/pxq_llama users: that engine injects enable_thinking into the template context
> unconditionally, so it was never affected by the polarity. This fix matters for HF transformers, Ollama and
> vLLM, which leave the variable undefined. To turn reasoning off on the server, use --reasoning off;
> --reasoning-budget 0 does not work for this template.
Quant tiers
| Tier | Notes |
|---|---|
| PXQU24 / PXQU32 / PXQU48 | universal mixed-tier PXQ (knapsack-optimized) |
| PXQ2 / PXQ4 / PXQ6 | flat PXQ ladder (PXQ6 = real 5-bit) |
_All tiers carry grafted MTP heads. Vanilla (no imatrix)._
Speed & benchmarks
🔧 Tests in progress — SWE-bench Lite + 179-Q reasoning gauntlet + per-tier decode t/s landing soon. This card is a placeholder until those numbers are in.
Run poisonxa/PXA-Fusion-122B-A5B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models