batiai/Qwen3.5-27B-GGUF overview
Qwen 3.5 27B GGUF — Quantized by BatiAI 🆕 Newer model available — Qwen3.8 27B GGUF https://huggingface.co/batiai/Qwen3.8 27B GGUF Qwen's 2026 08 release. Same…
Runs locally from ~14.05 GB disk (16 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen-Qwen3.5-27B-IQ4_XS.gguf | GGUF | IQ4_XS | 14.05 GB | Download |
Model Details
| Model ID | batiai/Qwen3.5-27B-GGUF |
|---|---|
| Author | batiai |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | Qwen/Qwen3.5-27B |
| Last modified | 2026-08-16T23:54:47.000Z |
Model README
---
language:
- en
- ko
- ja
- zh
license: apache-2.0
tags:
- gguf
- qwen
- quantized
- apple-silicon
- ollama
- batiai
- on-device
base_model: Qwen/Qwen3.5-27B
pipeline_tag: text-generation
library_name: llama.cpp
---
Qwen 3.5 27B GGUF — Quantized by BatiAI
> 🆕 Newer model available — Qwen3.8-27B GGUF
> Qwen's 2026-08 release. Same 27B class, six quants from 10 GB, vision included, Korean-verified.
> ollama run batiai/qwen3.8-27b:iq4
<p align="center">
<a href="https://flow.bati.ai"><img src="https://img.shields.io/badge/BatiFlow-macOS%20AI%20Automation-blue?style=for-the-badge&logo=apple" alt="BatiFlow"></a>
<a href="https://ollama.com/batiai/qwen3.5-27b"><img src="https://img.shields.io/badge/Ollama-batiai%2Fqwen3.5--27b-green?style=for-the-badge" alt="Ollama"></a>
</p>
> IQ4_XS quantization of Qwen/Qwen3.5-27B for on-device AI on Mac.
> Built and verified by BatiAI for BatiFlow.
Quick Start
ollama pull batiai/qwen3.5-27b:iq4Available Quantizations
| Quant | Size | VRAM | M4 Max (128GB) | Recommended For |
|-------|------|------|----------------|----------------|
| IQ4_XS | 14GB | 28GB | 17.0 t/s | 32GB+ Mac |
Benchmarks — M4 Max (128GB)
| Metric | IQ4_XS |
|--------|--------|
| Token generation | 17.0 t/s |
| Korean | ✅ |
| Tool call JSON | ✅ |
| VRAM | 28 GB |
vs Other Qwen 3.5 Models
| Model | Size | VRAM | Speed | Min Mac |
|-------|------|------|-------|---------|
| batiai/qwen3.5-9b:q4 | 5.2GB | ~8GB | 12.5 t/s | 16GB |
| batiai/qwen3.5-27b:iq4 | 14GB | 28GB | 17.0 t/s | 32GB |
| batiai/qwen3.5-35b:iq4 | 17GB | 23GB | 26.6 t/s | 36GB |
For 36GB+ Mac, consider batiai/qwen3.5-35b — MoE architecture, faster and less VRAM.
Technical Details
- Original Model: Qwen/Qwen3.5-27B
- Architecture: Hybrid (Gated DeltaNet + GQA + MoE)
- Context Window: 262K tokens
- License: Apache 2.0
- Quantized with: llama.cpp (build 400ac8e)
About BatiFlow
BatiFlow — free, on-device AI automation for Mac. 5MB app, 100% local, unlimited.
License
Quantized from Qwen/Qwen3.5-27B. License: Apache 2.0.
Benchmarks
<!-- BENCH-START -->
| Machine | Quant | Cold start | Prompt eval | Token gen | Tested |
|---------|-------|------------|-------------|-----------|--------|
| MacBook Pro M4 Max 128GB | IQ4_XS | 4.827s | 82.37 t/s | 11.71 t/s | 2026-05-03 |
<!-- BENCH-END -->
Run batiai/Qwen3.5-27B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models