GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ProCreations/grug-27b-v1.1-mtp-gguf overview

grug 27b v1.1 mtp — GGUF grug in box, with draft head still inside . same weight as ProCreations/grug 27b v1.1 mtp https://huggingface.co/ProCreations/grug 27b…

ggufgrugmtpspeculative-decodingllama.cpptext-generationenbase_model:ProCreations/grug-27b-v1.1-mtpbase_model:quantized:ProCreations/grug-27b-v1.1-mtplicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~884.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation

Repository Files & Downloads

4 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
grug-27b-v1.1-mtp-Q4_K_M.ggufGGUFQ4_K_M15.66 GBDownload
grug-27b-v1.1-mtp-Q6_K.ggufGGUFQ6_K20.89 GBDownload
grug-27b-v1.1-mtp-Q8_0.ggufGGUFQ8_027.05 GBDownload
mmproj-grug-27b-v1.1-mtp-f16.ggufGGUFF16884.6 MBDownload

Model Details

Model IDProCreations/grug-27b-v1.1-mtp-gguf
AuthorProCreations
Pipelinetext-generation
Licenseapache-2.0
Base modelProCreations/grug-27b-v1.1-mtp
Last modified2026-08-17T17:39:14.000Z

Model README

---

license: apache-2.0

base_model: ProCreations/grug-27b-v1.1-mtp

tags:

  • grug
  • gguf
  • mtp
  • speculative-decoding
  • llama.cpp

language:

  • en

pipeline_tag: text-generation

---

grug-27b-v1.1-mtp — GGUF

grug in box, with draft head still inside. same weight as

ProCreations/grug-27b-v1.1-mtp.

normal grug GGUF throw the MTP head away (--no-mtp) because it just make file

bigger for nothing. this build keep it, as blk.64.nextn.* tensor, so engine

that do speculative decoding can guess ahead.

| file | size | vs no-mtp build |

|---|---|---|

| grug-27b-v1.1-mtp-Q8_0.gguf | 29.0 GB | +0.4 GB |

| grug-27b-v1.1-mtp-Q6_K.gguf | 22.4 GB | +0.3 GB |

| grug-27b-v1.1-mtp-Q4_K_M.gguf | 16.8 GB | +0.3 GB |

| mmproj-grug-27b-v1.1-mtp-f16.gguf | 0.9 GB | eyes, same |

the small extra size IS the draft head.

which repo you want

smaller, 5 quant, no dead weight.

  • speculative decoding -> this one.

draft head only help when your engine actually use it. if your runtime ignore

nextn, you carry 0.3 GB for nothing — take the other repo.

why draft head retuned

Qwen3.8 native head agree with grug verifier 90.04% of time at t+2. grug

retune it on grug own output and get 95.37% — disagree 1-in-21 instead of

1-in-10. higher agree = more draft token accepted = faster.

number is top-1 agreement with verifier, not measured wall-clock speedup.

receipt and method on the

MTP model card.

run

llama-cli -m grug-27b-v1.1-mtp-Q4_K_M.gguf -p "write a function that flattens a nested list"

verified output identical to non-MTP grug. draft head change speed, never answer.

quant load-tested with llama-bench before upload. **use medium reasoning

effort** — full table on the

main card.

apache-2.0.

Run ProCreations/grug-27b-v1.1-mtp-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models