GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

EnclaveHost/qwen3.6-27b-mtp-gguf overview

qwen3.6 27b mtp gguf Enclave model volume Curated model volume for Enclave https://enclave.host confidential inference: Qwen3.6 27B MTP at unsloth Dynamic Q4 K…

ggufqwen3.6mtpenclavelicense:apache-2.0endpoints_compatibleregion:usimatrixconversational

Runs locally from ~16.68 GB disk (24 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.6-27B-UD-Q4_K_XL.ggufGGUFQ4_K_XL16.68 GBDownload

Model Details

Model IDEnclaveHost/qwen3.6-27b-mtp-gguf
AuthorEnclaveHost
Pipeline
Licenseapache-2.0
Base modelQwen/Qwen3.6-27B-MTP
Last modified2026-07-25T03:30:08.000Z

Model README

---

license: apache-2.0

base_model: Qwen/Qwen3.6-27B-MTP

tags:

  • gguf
  • qwen3.6
  • mtp
  • enclave

---

qwen3.6-27b-mtp-gguf (Enclave model volume)

Curated model volume for Enclave confidential inference:

Qwen3.6-27B-MTP at unsloth Dynamic Q4_K_XL (~17.9 GB), a single-file GGUF

bundled with the official tokenizer.json so the volume is self-contained.

This is the SELF-DRAFTING variant of qwen3.6-27b-gguf: the GGUF carries the

model's trained multi-token-prediction head (one extra layer), and llm-chat's

"draft": "mtp" setting uses it for speculative decoding - the head proposes

the next few tokens at near-zero cost and the trunk verifies them in one pass.

Output is byte-for-byte the trunk's own (exact-match verification); the head

only changes speed. No separate draft model, no second weights allocation -

prefer this volume over the plain 27b + a draft-model pairing.

Upstream unsloth/Qwen3.6-27B-MTP-GGUF

ships many quantizations plus vision mmproj files and no tokenizer.json.

This volume carries ONLY the one served quant plus the tokenizer (same

rationale as the sibling volumes).

Provenance

| File | Upstream | Revision | sha256 |

|------|----------|----------|--------|

| Qwen3.6-27B-UD-Q4_K_XL.gguf | unsloth/Qwen3.6-27B-MTP-GGUF | 5cb35eb3dcbf52dbce5f87dbc64df6aaffadcace | 4085665ee36d82a672a238a43f0e5643f2f0e39f2d7bd5d373f0ef10ecf53095 |

| tokenizer.json | Qwen/Qwen3.6-27B | (byte-identical family copy) | 5f9e4d4901a92b997e463c1f46055088b6cca5ca61a6522d1b9f64c4bb81cb42 |

The tokenizer is byte-identical to the qwen3.6-27b-gguf / qwen3.5-9b-gguf /

qwen3.5-122b-gguf / qwen3.5-0.8b-gguf copies (vocab 248320,

<|im_end|> 248046 / <|endoftext|> 248044).

Model geometry (GGUF arch qwen35, hybrid-SSM trunk + 1 dense-attention MTP

layer): 64 trunk layers, full_attention_interval 4 (16 trunk KV layers), 4 KV

heads, head_dim 256. For VRAM budgeting count the MTP head as one more

full-attention KV layer (17 total) - its context is created lazily when a

speculative session first opens.

LICENSE is the Apache-2.0 text; both upstreams are Apache-2.0.

Usage on Enclave

Wrapped as a Tinfoil Modelwrap volume (dm-verity; the root hash is part of the

enclave measurement). Deployments attach it by name; the wasm-manager mounts it

read-only at /models/qwen3.6-27b-mtp-gguf.

Run EnclaveHost/qwen3.6-27b-mtp-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models