GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

jakeatx/ATX-Swift-Qwen3.8-27B-Uncensored-TQ2_0-MTP-GGUF overview

ATX Swift Qwen3.8 27B Uncensored TQ2 0 MTP GGUF Ternary 2 bit quantization TQ2 0 with native Multi Token Prediction MTP draft head for d0xin/Swift Qwen3.8 27B …

ggufllama.cppqwen3_8ternaryturboquanttq2_0uncensoredmtptext-generationbase_model:d0xin/Swift-Qwen3.8-27B-Uncensored-BF16base_model:quantized:d0xin/Swift-Qwen3.8-27B-Uncensored-BF16license:otherendpoints_compatibleregion:usconversational

Runs locally from ~7.61 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
ATX-Swift-Qwen3.8-27B-Uncensored-TQ2_0-MTP.ggufGGUFGGUF7.61 GBDownload

Model Details

Model IDjakeatx/ATX-Swift-Qwen3.8-27B-Uncensored-TQ2_0-MTP-GGUF
Authorjakeatx
Pipelinetext-generation
Licenseother
Base modeld0xin/Swift-Qwen3.8-27B-Uncensored-BF16
Last modified2026-09-18T17:28:58.000Z

Model README

---

license: other

license_name: swift-open-license-1.0

library_name: gguf

pipeline_tag: text-generation

base_model: d0xin/Swift-Qwen3.8-27B-Uncensored-BF16

tags:

  • gguf
  • llama.cpp
  • qwen3_8
  • ternary
  • turboquant
  • tq2_0
  • uncensored
  • mtp

---

ATX-Swift-Qwen3.8-27B-Uncensored-TQ2_0-MTP-GGUF

Ternary 2-bit quantization (TQ2_0) with native Multi-Token Prediction (MTP) draft head for d0xin/Swift-Qwen3.8-27B-Uncensored-BF16.

Overview

  • Quant Format: TQ2_0 (TurboQuant 2.06 bpw ternary, ~2.39 BPW container with critical tensors preserved). TurboQuant applies randomized Walsh-Hadamard transform (WHT) rotations dynamically during quantization to suppress outlier channels and retain coherence on dense weights without retraining.
  • MTP Speculative Decoding: Native layer 64 (blk.64.*) fused directly into the model (qwen35.block_count: 65). Ready for self-speculative decoding in llama.cpp and llamAmpere without needing an external drafter model.
  • Size: 8,167,151,488 bytes (7.61 GiB)
  • SHA256: d8165afb60195352f417681fa6348acbfb743c9e6bdc7ba87b9bf1a1e37ea086

Usage with llama.cpp / llamAmpere

llama-server -m ATX-Swift-Qwen3.8-27B-Uncensored-TQ2_0-MTP.gguf   -ngl 99 -fa on -c 32768   --spec-type draft-mtp --spec-draft-n-max 3 --spec-draft-p-min 0.45

Run jakeatx/ATX-Swift-Qwen3.8-27B-Uncensored-TQ2_0-MTP-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models