---

license: cc-by-nc-4.0

base_model: Hcompany/Holo4-27B

base_model_relation: quantized

pipeline_tag: image-text-to-text

library_name: gguf

tags:

- gguf

- llama.cpp

- holo4

- qwen3.5

- multimodal

- computer-use

- agent

---

Holo4-27B GGUF

GGUF quantizations of Hcompany/Holo4-27B, a 27B dense vision-language model (VLM) for Computer Use, tool-driven work, and agentic workflows.

For image input, use the included F16 vision projector (mmproj-Holo4-27B-f16.gguf).

Upstream benchmarks

!Holo4-27B benchmark results

Results reported by H Company from evaluations of the original Holo4-27B model across computer tasks, long workflows, and tool servers.

GGUF files

| Quantization | File | Size | Notes |

| --- | --- | ---: | --- |

| Q4_0 | Holo4-27B-Q4_0.gguf | 15.5 GB | Standard Q4 0-quant |

| Q4_K_M | Holo4-27B-Q4_K_M.gguf | 16.5 GB | Recommended balanced default |

| Q5_K_M | Holo4-27B-Q5_K_M.gguf | 19.2 GB | Higher-quality Q5 option |

| Q6_K | Holo4-27B-Q6_K.gguf | 22.1 GB | High-quality option |

| Q8_0 | Holo4-27B-Q8_0.gguf | 28.6 GB | Near-lossless reference quantization |

| Vision projector | mmproj-Holo4-27B-f16.gguf | 931 MB | Required for image input |

Usage

Use a current llama.cpp build with the included chat template.

llama-cli \
  -m Holo4-27B-Q4_K_M.gguf \
  -c 4096 -n 512 --temp 0.7 --top-p 0.8 \
  --jinja --chat-template-file chat_template.jinja \
  -p "<|im_start|>user\nWhat is computer use in AI?<|im_end|>\n<|im_start|>assistant\n"

For multimodal / image input:

llama-mtmd-cli \
  -m Holo4-27B-Q4_K_M.gguf \
  -mm mmproj-Holo4-27B-f16.gguf \
  --image screenshot.png \
  -p "Describe the interface in this screenshot."

Source

• Model: Hcompany/Holo4-27B
• Chat template revision: 4de03cf
• License: cc-by-nc-4.0
• Checksums: SHA256SUMS