GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

Heroholland/Qwythos-27B-v1-Q6_K-GGUF overview

Heroholland/Qwythos-27B-v1-Q6_K-GGUF GGUF downloads for local AI inference with guIDE.

ggufendpoints_compatibleregion:usimatrixconversational

Runs locally from ~888.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwythos-27B-Q6_K.ggufGGUFQ6_K20.89 GBDownload
mmproj-Qwythos-F16.ggufGGUFF16888.0 MBDownload

Model Details

Model IDHeroholland/Qwythos-27B-v1-Q6_K-GGUF
AuthorHeroholland
Pipeline
License
Base model
Last modified2026-07-30T12:06:46.000Z

Run Heroholland/Qwythos-27B-v1-Q6_K-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models