ProCreations/grug-v1.1-qwen-3.8-27b-gguf overview
grug v1.1 qwen 3.8 27b — GGUF grug in box for llama.cpp. same brain as ProCreations/grug v1.1 qwen 3.8 27b https://huggingface.co/ProCreations/grug v1.1 qwen 3…
Runs locally from ~884.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| grug-27b-v1.1-Q3_K_M.gguf | GGUF | Q3_K_M | 12.39 GB | Download |
| grug-27b-v1.1-Q4_K_M.gguf | GGUF | Q4_K_M | 15.41 GB | Download |
| grug-27b-v1.1-Q5_K_M.gguf | GGUF | Q5_K_M | 17.91 GB | Download |
| grug-27b-v1.1-Q6_K.gguf | GGUF | Q6_K | 20.57 GB | Download |
| grug-27b-v1.1-Q8_0.gguf | GGUF | Q8_0 | 26.63 GB | Download |
| mmproj-grug-27b-v1.1-f16.gguf | GGUF | F16 | 884.6 MB | Download |
Model Details
| Model ID | ProCreations/grug-v1.1-qwen-3.8-27b-gguf |
|---|---|
| Author | ProCreations |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | ProCreations/grug-v1.1-qwen-3.8-27b |
| Last modified | 2026-08-18T20:14:53.000Z |
Model README
---
license: apache-2.0
base_model: ProCreations/grug-v1.1-qwen-3.8-27b
tags:
- grug
- gguf
- llama.cpp
- token-efficient
- agentic
language:
- en
pipeline_tag: text-generation
---
grug-v1.1-qwen-3.8-27b — GGUF
grug in box for llama.cpp. same brain as
ProCreations/grug-v1.1-qwen-3.8-27b,
just smaller box.
| file | size | who for |
|---|---|---|
| grug-27b-v1.1-Q8_0.gguf | 28.6 GB | want closest to full weight |
| grug-27b-v1.1-Q6_K.gguf | 22.1 GB | very good, less space |
| grug-27b-v1.1-Q5_K_M.gguf | 19.2 GB | good middle |
| grug-27b-v1.1-Q4_K_M.gguf | 16.5 GB | grug pick this one for most cave |
| grug-27b-v1.1-Q3_K_M.gguf | 13.3 GB | small cave, tight RAM |
| mmproj-grug-27b-v1.1-f16.gguf | 0.9 GB | eyes. only need if you show picture |
every quant load-tested with llama-bench before upload. built with llama.cpp
7c35571e.
run grug
llama-cli -m grug-27b-v1.1-Q4_K_M.gguf -p "write a function that flattens a nested list"
with eyes:
llama-mtmd-cli -m grug-27b-v1.1-Q4_K_M.gguf \
--mmproj mmproj-grug-27b-v1.1-f16.gguf --image cave-painting.png -p "what this?"
grug think small
grug reason inside <think> in caveman, then answer in normal english. on agent
step grug spend 20 think token where base model spend 108.5. on HumanEval
grug spend 79.5 where base spend 559.
use medium reasoning effort. xhigh make grug worse at picking tool (76.5 vs
97.1) — full table and chart on the
apache-2.0.
Run ProCreations/grug-v1.1-qwen-3.8-27b-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models