EnclaveHost/qwen3.6-27b-mtp-gguf overview
qwen3.6 27b mtp gguf Enclave model volume Curated model volume for Enclave https://enclave.host confidential inference: Qwen3.6 27B MTP at unsloth Dynamic Q4 K…
Runs locally from ~16.68 GB disk (24 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.6-27B-UD-Q4_K_XL.gguf | GGUF | Q4_K_XL | 16.68 GB | Download |
Model Details
| Model ID | EnclaveHost/qwen3.6-27b-mtp-gguf |
|---|---|
| Author | EnclaveHost |
| Pipeline | — |
| License | apache-2.0 |
| Base model | Qwen/Qwen3.6-27B-MTP |
| Last modified | 2026-07-25T03:30:08.000Z |
Model README
---
license: apache-2.0
base_model: Qwen/Qwen3.6-27B-MTP
tags:
- gguf
- qwen3.6
- mtp
- enclave
---
qwen3.6-27b-mtp-gguf (Enclave model volume)
Curated model volume for Enclave confidential inference:
Qwen3.6-27B-MTP at unsloth Dynamic Q4_K_XL (~17.9 GB), a single-file GGUF
bundled with the official tokenizer.json so the volume is self-contained.
This is the SELF-DRAFTING variant of qwen3.6-27b-gguf: the GGUF carries the
model's trained multi-token-prediction head (one extra layer), and llm-chat's
"draft": "mtp" setting uses it for speculative decoding - the head proposes
the next few tokens at near-zero cost and the trunk verifies them in one pass.
Output is byte-for-byte the trunk's own (exact-match verification); the head
only changes speed. No separate draft model, no second weights allocation -
prefer this volume over the plain 27b + a draft-model pairing.
Upstream unsloth/Qwen3.6-27B-MTP-GGUF
ships many quantizations plus vision mmproj files and no tokenizer.json.
This volume carries ONLY the one served quant plus the tokenizer (same
rationale as the sibling volumes).
Provenance
| File | Upstream | Revision | sha256 |
|------|----------|----------|--------|
| Qwen3.6-27B-UD-Q4_K_XL.gguf | unsloth/Qwen3.6-27B-MTP-GGUF | 5cb35eb3dcbf52dbce5f87dbc64df6aaffadcace | 4085665ee36d82a672a238a43f0e5643f2f0e39f2d7bd5d373f0ef10ecf53095 |
| tokenizer.json | Qwen/Qwen3.6-27B | (byte-identical family copy) | 5f9e4d4901a92b997e463c1f46055088b6cca5ca61a6522d1b9f64c4bb81cb42 |
The tokenizer is byte-identical to the qwen3.6-27b-gguf / qwen3.5-9b-gguf /
qwen3.5-122b-gguf / qwen3.5-0.8b-gguf copies (vocab 248320,
<|im_end|> 248046 / <|endoftext|> 248044).
Model geometry (GGUF arch qwen35, hybrid-SSM trunk + 1 dense-attention MTP
layer): 64 trunk layers, full_attention_interval 4 (16 trunk KV layers), 4 KV
heads, head_dim 256. For VRAM budgeting count the MTP head as one more
full-attention KV layer (17 total) - its context is created lazily when a
speculative session first opens.
LICENSE is the Apache-2.0 text; both upstreams are Apache-2.0.
Usage on Enclave
Wrapped as a Tinfoil Modelwrap volume (dm-verity; the root hash is part of the
enclave measurement). Deployments attach it by name; the wasm-manager mounts it
read-only at /models/qwen3.6-27b-mtp-gguf.
Run EnclaveHost/qwen3.6-27b-mtp-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models