---

license: apache-2.0

base_model: JonathanColetti/Qwen3.8-27B-Uncensored

library_name: gguf

tags:

• text-generation
• gguf
• quantizer
• autoround
• architecture-aware
• mamba
• ssm
• multi-token-prediction
• mtp
• uncensored
• 27b

---

<!-- zerodigest-lab-banner-v2-mid-tone -->

<div style="background: #1f1f23; color: #f4f4f5; padding: 20px; border: 1px solid #38bdf8; border-radius: 8px; margin: 20px 0; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif;">

<h2 style="color: #38bdf8; margin: 0 0 10px 0; font-size: 18px; font-weight: 700; letter-spacing: -0.5px;">⚡ Fuel the Lab: Keep the Optimization Loops Running</h2>

<p style="font-size: 14px; line-height: 1.5; margin: 0 0 16px 0; color: #d4d4d8;">Every single <b>ZeroDigest YMQ-MTP</b> release is handcrafted and manually calibrated via intensive importance-matrix sweeps to protect critical logic pathways. This project is entirely independent research—no automation bots, no corporate backers, and no external funding. Running multi-hour compute arrays consumes massive local infrastructure overhead out-of-pocket. Consider checking out our compiler or supporting our compute costs!</p>

<div style="background: #18181b; padding: 12px; border-radius: 6px; border: 1px solid #3f3f46; font-size: 13px;">

<p style="margin: 0 0 8px 0; font-weight: 600; color: #f4f4f5;">👉 Developer Resources & Support Paths:</p>

<div style="margin-bottom: 6px;">🛠️ <a href="https://github.com/minyor/ymq-compiler" target="_blank" style="color: #38bdf8; text-decoration: underline; font-weight: bold;">View Compiler Source on GitHub (YMQ v2.0)</a></div>

<div style="margin-bottom: 6px;">🚀 <a href="https://runpod.io?ref=dbjmkmeh" target="_blank" style="color: #38bdf8; text-decoration: underline; font-weight: bold;">Deploy weights on RunPod Cloud Compute (Affiliate Link)</a></div>

<div style="margin-bottom: 8px;">☕ <a href="https://ko-fi.com/zerodigest" target="_blank" style="color: #38bdf8; text-decoration: underline; font-weight: bold;">Support the Lab on Ko-fi (One-Time / Monthly)</a></div>

<div style="margin: 8px 0; border-top: 1px solid #3f3f46;"></div>

<div style="margin-bottom: 4px; font-family: monospace;">🧡 <span style="color: #f97316; font-weight: bold;">BTC:</span> <code style="background: #27272a; padding: 1px 4px; border-radius: 4px; color: #f4f4f5;">14Fmic9z3VA1ZU11bWoP6JtU7csTAApwZo</code></div>

<div style="font-family: monospace;">🔷 <span style="color: #6366f1; font-weight: bold;">ETH/USDT:</span> <code style="background: #27272a; padding: 1px 4px; border-radius: 4px; color: #f4f4f5;">0xbe4cdc3adc27c21ef1c27c6b403311db07b35ed2</code></div>

</div>

</div>

Qwen3.8-27B-Uncensored-YMQ-MTP-GGUF

> Source Model: JonathanColetti/Qwen3.8-27B-Uncensored

⚖️ An Architecture-Aware, AutoRound-Inspired Mixed Precision Layout

This repository features advanced, custom architecture-aware quantizations of Qwen3.8-27B (Uncensored) processed directly from official raw BF16 source files using the custom YMQ-Compiler (v2.0) log-space framework.

These builds natively support parallel multi-token prediction (MTP) speculation engines and utilize high-context optimization parameters tailored for demanding code development API execution environments (such as RooCode/Aider).

<p align="center">

<img src="./logo.jpg" width="800" alt="ZeroDigest YMQ Logo">

</p>

---

📊 Quantization Preset Tier Details

| Preset Tier | Total Size | Target Usage / Memory VRAM Profile | Cognitive Real-World Coding Quality |

| :--- | :--- | :--- | :--- |

| XXS-Pro | ~9.3 GB | ⚠️ Experimental Low-VRAM Sandbox | The Ultra-Compact Frontier. Perplexity = 8.2084. Packs the 27B dense matrix into a sub-10GB footprint. In intense multi-stage agent workflows, it can occasionally trigger context amnesia or formatting loops, but features heavily insulated upper routing tracks to protect basic logical structures. |

| XXS | ~9.8 GB | Absolute VRAM Squeeze / 12GB Card Lifeline | Massive structural quantization noise. Best restricted to low-context, single-turn instructions. Fits 12GB cards with context cache breathing room. |

| XS-TI | ~10.2 GB | ⚡ 12GB Card Lifeline (High-Context) | The 12GB Context Champion. Safely pins core attention layers to a stable IQ3_XXS gradient while crushing non-critical auxiliary arrays to IQ2_XS. |

| XS-Pro | ~11.0 GB | ⚡ Dedicated 12GB VRAM Champion | High compression economy baseline. Optimized to prevent API degradation during deep context tasks. |

| S-Pro | ~12.5 GB | 💎 16GB Workstation Driver | Pristine conversational fluidness, using full attention armor. |

| M-TI | ~12.6 GB | 💎 Premium 16GB GPU Workspace Driver | The 16GB Workstation Choice. Employs a robust Q5_K/IQ4_XS mixed-precision gradient that protects logical reasoning focus while leaving over 3.4GB of VRAM wide open. |

| M | ~14.5 GB | The Ultimate Coding Sweet Spot (Recommended) | Elite logical stability. Complete logic clarity. It crushes standard industry 4-bit alternatives. |

| L-TI | ~14.1 GB | 🔥 Heavy 16GB Workstation Choice (Precision) | The 16GB High-Fidelity Champion. Features a robust Q6_K/IQ4_NL armored peak [local]. Minimizes information entropy drift to keep structural logic stable over long, multi-turn agent execution loops. |

| L | ~17.0 GB | Premium Single-GPU Processing / Heavy workloads | Near-lossless instruction formatting. Pristine multi-turn architecture safety. |

| XL | ~19.0 GB | Maximum VRAM Fill / No Compromises | Mathematical saturation ceiling. Full precision logic tracks for massive multi-file codebase operations. |

🎯 Quick Selection Guide

| Use Case | Recommended Preset | Why |

| :--- | :--- | :--- |

| 12GB GPU | XS-TI or XS-Pro | Best 12GB card performance with high-context support |

| 16GB GPU (Recommended) | M-TI or S-Pro | The sweet spot for coding tasks with optimal VRAM headroom |

| 24GB GPU | L-TI or M | ~14GB models fit well on 24GB VRAM with headroom for context |

| Low-VRAM / Experimental | XXS-Pro | Sub-10GB footprint for testing and lightweight workflows |

📉 Perplexity Evaluation Metrics (WikiText-2)

The following metrics demonstrate the mathematical quality preservation of the YMQ-Compiler log-space cluster analysis compared to standard linear quantization layouts. Tested natively via llama-perplexity over a 4096 context window using the official WikiText-2 test corpus.

| Model Variant | File Size | Perplexity | Mean KL-Divergence | Internal Bit Gradient (High ➔ Mid ➔ Low ➔ Default ➔ Floor) |

| :--- | :--- | :--- | :--- | :--- |

| XXS-Pro | ~9.3 GB | 8.2084 | 0.185361 ± 0.0021 | IQ3_XXS ➔ IQ3_XXS ➔ IQ2_S ➔ IQ2_S ➔ IQ2_XXS |

| XXS | ~9.8 GB | 7.6538 | 0.193804 ± 0.0022 | IQ3_XXS ➔ IQ2_S ➔ IQ2_XS ➔ IQ2_XS (No Floor) |

| XS-TI | ~10.2 GB | 7.6169 | 0.168378 ± 0.001935 | IQ3_XXS ➔ IQ3_XXS ➔ IQ3_XXS ➔ IQ3_XXS ➔ IQ2_XXS |

| XS-Pro | ~11.0 GB | 7.1665 | 0.135866 ± 0.0018 | IQ4_XS ➔ IQ3_XXS ➔ IQ3_XXS ➔ IQ3_XXS ➔ IQ2_XXS |

| S-Pro | ~12.5 GB | 7.0687 | 0.080403 ± 0.0014 | Q5_K ➔ IQ3_S ➔ IQ3_XXS ➔ IQ3_XXS (No Floor) |

| M-TI | ~12.9 GB | 7.0419 | 0.104087 ± 0.0016 | Q5_K ➔ IQ4_XS ➔ IQ3_S ➔ IQ3_XXS ➔ IQ2_XXS |

| M | ~14.5 GB | 6.8176 | 0.053286 ± 0.0013 | Q5_K ➔ IQ4_XS ➔ IQ3_S ➔ IQ3_XXS (No Floor) |

| L-TI | ~14.1 GB | 7.1788 | 0.086571 ± 0.0013 | Q6_K ➔ IQ4_NL ➔ IQ4_XS ➔ IQ3_S ➔ IQ2_XS |

| L | ~17.0 GB | 6.9832 | 0.031546 ± 0.0009 | Q6_K ➔ Q5_K ➔ IQ4_NL ➔ IQ3_S (No Floor) |

| XL | ~19.0 GB | 6.8329 | 0.011598 ± 0.0005 | Q6_K ➔ Q6_K ➔ Q5_K ➔ IQ4_NL (No Floor) |

🚨 CRITICAL ARCHITECTURAL UPDATE

• Legacy S Preset Deprecated: The older, standard S configuration (~12.2 GB) has been officially removed from the repository.
• Upgrade to S-Pro (~12.5 GB): We have replaced it with the newly engineered S-Pro preset.

• Legacy XS Preset Deprecated: The older, standard XS configuration (~11.0 GB) has been permanently removed from the repository tree.
• Upgrade to XS-Pro (~10.5 GB): We have officially replaced it with the newly engineered XS-Pro preset. Score 7.1665 vs old XS score 8.1516

💡 The Multi-Tier Grid Breakthrough: Standard S vs. S-Pro

During intensive local workspace validation passes, our architecture-aware YMQ-Compiler successfully mapped out a radical new bit-allocation matrix. By splitting the layer distribution, we created a premium, high-fidelity alternative to our standard budget tier:

• Standard S Preset (~12.2 GB): Perplexity = 8.0351. Features a balanced log-space gradient. Highly capable of handling single-turn scripts and quick edits. Successfully ingested a clean 91kb codebase chunk to resolve deep priority-ordered dictionary bugs natively.
• S-Pro Preset (~12.5 GB): Perplexity = 7.0687. By aggressively compressing auxiliary tensor lanes down to Q2_K but raising the background baseline floor to IQ3_XXS, S-Pro eliminates a massive wave of background quantization noise—dropping paper perplexity by a massive ~1.0 point while only adding a few megabytes of file weight.

The practical result is a premium, low-overhead everyday driver for 16GB GPU setups. Backed by full Q5_K reasoning armor.

💡 The Uncensored Performance Breakthrough

Notice that the Uncensored M preset achieves an elite score of 6.8176, outperforming even the original base model's score (6.8413). This occurs because removing the artificial refusal safety layers allows the model's underlying Attention and Mamba SSM weights to predict text paths with absolute, unrestricted mathematical clarity.

By pairing JonathanColetti's pristine abliteration weights with the YMQ-Compiler's log-space gate insulation, this preset matches the raw reasoning power of the massive 19GB XL file while clawing back a clean 5 Gigabytes of VRAM overhead cache space for local RooCode/Aider coding loops!

💡 Engineering Notes on the XXS-Pro Layout

The XXS-Pro preset is a highly aggressive exploration pass utilizing an optimized mixed-precision architecture template:

HIGH="IQ3_XXS" (3.0 BPW) -> MID="IQ3_XXS" -> LOW="IQ2_S" (2.5 BPW) -> FLOOR="IQ2_XXS" (2.06 BPW).

By adding custom FLOOR_TARGET parameters, we aggressively crushed the auxiliary and background matrix noise to stay beneath a hard 9.5 GB memory limit. While this compression level introduces enough quantization noise to challenge complex multi-file edit loops, our log-space steering gate protection allows the model to retain surprisingly strong English language capabilities and shorter script tracking entirely within low-VRAM graphics memory buffers!

---

⚖️ YMQ vs. Uniform Quantization (The AutoRound Philosophy)

Standard quantization pipelines apply a blunt, uniform bit-depth across every single layer in a model. This wastes valuable VRAM on silent background layers while starving critical logic anchors of necessary precision.

The YMQ-Compiler implements a philosophy similar to advanced weight-tuning frameworks like Intel's AutoRound:

• Targeted Bit Allocation: It strips bits away from low-leverage background tensors and automatically re-allocates that saved VRAM budget straight into full high-fidelity shields for the model's highest cognitive spikes and boundary pathways.
• Instant Optimization: Instead of running heavy, days-long optimization training loops, YMQ achieves a highly accurate mixed-precision layout instantly by analyzing layer importance metrics in log-space.

The result is a custom mixed-precision portfolio that matches the low perplexity and high context stability of premium optimized quants (like AutoRound), while maintaining an ultra-lightweight, high-speed single-GPU cache footprint.

---

🛠️ The YMQ Compilation Architecture

Standard quantization pipelines treat network tensors like a flat dataset, applying destructive blanket low-bit compression to delicate tracking networks. The YMQ-Compiler solves high-context logic decay by parsing model files dynamically via an automated, multi-tiered protection matrix:

1. Log-Space Gap Detection Clustering: Instead of flat percentage thresholds, the engine computes statistical cluster variances in log-space, successfully isolating intermediate logical reasoning spikes and elevating them to stable non-linear 4-bit (IQ4_XS) formats, while compressing idle fact-storage layers to aggressive 2-bit baselines.
2. Fading Boundary Tapering: Recognizes the extreme fragility of initial token entry data vectors, forcing an input wave cushion (L00=IQ4_NL → L01=IQ4_XS → L02=IQ3_XXS) that gradually stabilizes parameters before hitting the fallback pools.
3. Dedicated Gate Insulation: Hard-shields volatile parallel Transformer Multi-Head Attention and Mamba Linear State Space Model (SSM) routing paths, keeping context tracking perfectly noise-free.
4. Asymmetric Vocabulary Shielding: Fixes tied-weight boundary errors by mapping the final logit classification exit heads to robust configurations to completely eliminate formatting loops and API tag leakage under deep contexts.
5. Native Next-N Speculative Stripping: Processed with advanced pre-tokenizer stripping to ensure zero index offset drift or layer-shifting risks across hybrid configurations.

---

🚀 Recommended Runtime Parameters (llama.cpp / llama-server)

Need to scale up? Deploy this exact script on on-demand cloud GPUs via RunPod Cloud Compute.

$./llama-server -m models/Qwen3.8-27B-Uncensored-YMQ-M-TI.gguf -ctk q8_0 -ctv q4_0 --ctx-size 245760 --mmproj models/Qwen3.8-27B-Uncensored-vision-Q6_K.gguf \
  --spec-type draft-mtp --spec-draft-n-max 2 --timeout 36000 --checkpoint-min-step 2048 --ctx-checkpoints 4 \
  --n-predict -1 --temp 0.6 --top-p 0.95 --top-k 20 --repeat-penalty 1.05 --jinja -fa

🖼️ Vision Projection (--mmproj)

For multimodal vision support, pair these builds with one of the following projection files:

| Variant | File | Size | Notes |

| :--- | :--- | :--- | :--- |

| Full Precision (F16) | Qwen3.8-27B-Uncensored-vision-f16.gguf | ~928 GB | Full-precision vision tower, native to the Uncensored abliteration weights. Maximum fidelity for image reasoning tasks. |

| Q6_K | Qwen3.8-27B-Uncensored-vision-Q6_K.gguf (this repo) | ~587 MB | High-fidelity quantized vision tower. Excellent quality-to-size balance with minimal perceptible degradation. |

| Q4_K_S | Qwen3.8-27B-Uncensored-vision-Q4_K_S.gguf (this repo) | ~478 MB | Compact vision projection for VRAM-constrained setups. Retains strong image understanding at reduced footprint. |

Pass via --mmproj <path-to-file> in your llama-server invocation (see example above).

---

☕ Support & Future R&D

If the YMQ-Compiler builds saved your context window from collapsing or optimized your active development cycle speeds, consider buying a coffee to fund further low-level optimization research. Your support keeps the server nodes baking future model scales!

👉 Support ZeroDigest Research on ko-fi

---

📦 Source Framework & Automation Code

The compiler pipeline automation engine, setup thresholds, and structural mapping rules are open-source. To view the implementation details or compile your own custom models natively using this profile layout, visit the official development hub:

👉 GitHub: ZeroDigest / YMQ-Compiler