GraySoft
Download guIDE →
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ggml-org/Qwen3.5-0.8B-Base-GGUF overview

Qwen3.5 0.8B Base Run with https://llama.app bash llama serve hf ggml org/Qwen3.5 0.8B Base GGUF Source models https://huggingface.co/Qwen/Qwen3.5 0.8B Base TO…

ggufquantizedimage-text-to-textbase_model:Qwen/Qwen3.5-0.8B-Basebase_model:quantized:Qwen/Qwen3.5-0.8B-Baselicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~537.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
416
Likes
5
Pipeline
image-text-to-text
Author
ggml-org

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.5-0.8B-Base-BF16.ggufGGUFBF161.45 GBDownload
Qwen3.5-0.8B-Base-Q4_0.ggufGGUFQ4_0537.0 MBDownload
Qwen3.5-0.8B-Base-Q8_0.ggufGGUFQ8_0795.0 MBDownload

Model Details

Model IDggml-org/Qwen3.5-0.8B-Base-GGUF
Authorggml-org
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelQwen/Qwen3.5-0.8B-Base
Last modified2026-07-16T18:26:55.000Z

Model README

---

license: apache-2.0

pipeline_tag: image-text-to-text

tags:

  • gguf
  • quantized

base_model:

  • Qwen/Qwen3.5-0.8B-Base

---

Qwen3.5-0.8B-Base

Run with https://llama.app

llama serve -hf ggml-org/Qwen3.5-0.8B-Base-GGUF

Source models

  • https://huggingface.co/Qwen/Qwen3.5-0.8B-Base

TODOs

  • add info

> [!IMPORTANT]

> This model is automatically converted using https://github.com/ggml-org/convert

Run ggml-org/Qwen3.5-0.8B-Base-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models