Model Intelligence Sheet
jakeatx/Qwen3.8-27B-Ternary-PTQ1_0-MTP-GGUF overview
Qwen3.8 27B Ternary PTQ1 0 1.75 bpw with Native MTP Ternary 1.75 bpw quantization of Qwen3.8 27B Prism ML Ternary Bonsai 2 architecture with native 1 layer MTP…
Runs locally from ~5.81 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
1 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.8-27B-Ternary-PTQ1_0-MTP.gguf | GGUF | GGUF | 5.81 GB | Download |
Model Details
Model README
---
license: apache-2.0
tags:
- gguf
- qwen3_5
- ternary
- mtp
- speculative-decoding
- ampere
- sm86
---
Qwen3.8-27B Ternary PTQ1_0 (1.75 bpw) with Native MTP
Ternary (1.75 bpw) quantization of Qwen3.8-27B (Prism ML Ternary Bonsai 2 architecture) with native 1-layer MTP speculative drafting.
- Format:
PTQ1_0(group 128, 28 bytes/block, ~1.75 bpw) - Model Size: 5.81 GiB
- MTP Drafter: Native 1-layer MTP head
- Target Hardware: Single 24 GB GPU (RTX 3090 / 3090 Ti) with 262K context capacity under full offload
- Runtime: Optimized for llamAmpere (branch
feature/v0.3.1-bonsai2)
Usage with llamAmpere
./build-sm86/bin/llama-server \
-m Qwen3.8-27B-Ternary-PTQ1_0-MTP.gguf \
-c 32768 -b 4096 -ub 1024 -t 8 -ngl 99 -fa on -ctk q8_0 -ctv turbo3 \
--spec-type draft-mtp --spec-draft-n-max 3 --spec-draft-p-min 0Run jakeatx/Qwen3.8-27B-Ternary-PTQ1_0-MTP-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models