GraySoft
Projects Models About FAQ Contact Download guIDE →

ddh0/qwen3.5-gguf 8.69bpw GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

ddh0/qwen3.5-gguf overview

Full suite of GGUF quantizations for the Qwen3.5 series. Not including the 397B-A17B because it's too big for me to quant. See AesSedai/Qwen3.5-397B-A17B-GGUF for that one.

ggufbase_model:Qwen/Qwen3.5-0.8Bbase_model:quantized:Qwen/Qwen3.5-0.8Bendpoints_compatibleregion:usconversational
ddh0/qwen3.5-gguf visual
Downloads
10,065
Likes
3
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

52 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Qwen3.5-0.8B-9.71bpw.gguf GGUF 881.64 MB Download
Qwen3.5-0.8B-Base-9.71bpw.gguf GGUF 881.64 MB Download
Qwen3.5-122B-A10B-4.87bpw.gguf GGUF 69.24 GB Download
Qwen3.5-122B-A10B-6.17bpw.gguf GGUF 87.71 GB Download
Qwen3.5-122B-A10B-7.28bpw.gguf GGUF 103.55 GB Download
Qwen3.5-122B-A10B-8.68bpw.gguf GGUF 123.47 GB Download
Qwen3.5-122B-A10B-ddh0_v2-imatrix.gguf GGUF 342.28 MB Download
Qwen3.5-27B-4.00bpw.gguf GGUF 12.54 GB Download
Qwen3.5-27B-4.71.gguf GGUF 14.77 GB Download
Qwen3.5-27B-4.77bpw.gguf GGUF 14.96 GB Download
Qwen3.5-27B-5.12bpw.gguf GGUF 16.03 GB Download
Qwen3.5-27B-6.19bpw.gguf GGUF 19.39 GB Download
Qwen3.5-27B-8.16bpw.gguf GGUF 25.56 GB Download
Qwen3.5-27B-9.84bpw.gguf GGUF 30.83 GB Download
Qwen3.5-27B-ddh0_v2-imatrix.gguf GGUF 13.01 MB Download
Qwen3.5-2B-7.82bpw.gguf GGUF 1.74 GB Download
Qwen3.5-2B-9.58bpw.gguf GGUF 2.08 GB Download
Qwen3.5-2B-Base-7.82bpw.gguf GGUF 1.74 GB Download
Qwen3.5-2B-Base-9.58bpw.gguf GGUF 2.08 GB Download
Qwen3.5-2B-Base-ddh0_v2-imatrix.gguf GGUF 1.86 MB Download
Qwen3.5-2B-ddh0_v2-imatrix.gguf GGUF 1.86 MB Download
Qwen3.5-35B-A3B-4.96bpw.gguf GGUF 20.00 GB Download
Qwen3.5-35B-A3B-6.23bpw.gguf GGUF 25.15 GB Download
Qwen3.5-35B-A3B-8.69bpw.gguf GGUF 35.07 GB Download
Qwen3.5-35B-A3B-ddh0_v2-imatrix.gguf GGUF 183.32 MB Download
Qwen3.5-4B-7.10bpw.gguf GGUF 3.49 GB Download
Qwen3.5-4B-9.93bpw.gguf GGUF 4.87 GB Download
Qwen3.5-4B-Base-7.10bpw.gguf GGUF 3.49 GB Download
Qwen3.5-4B-Base-9.93bpw.gguf GGUF 4.87 GB Download
Qwen3.5-4B-Base-ddh0_v2-imatrix.gguf GGUF 3.46 MB Download
Qwen3.5-4B-ddh0_v2-imatrix.gguf GGUF 3.46 MB Download
Qwen3.5-9B-6.54bpw.gguf GGUF 6.83 GB Download
Qwen3.5-9B-8.15bpw.gguf GGUF 8.50 GB Download
Qwen3.5-9B-9.58bpw.gguf GGUF 9.99 GB Download
Qwen3.5-9B-Base-6.54bpw.gguf GGUF 6.83 GB Download
Qwen3.5-9B-Base-8.15bpw.gguf GGUF 8.50 GB Download
Qwen3.5-9B-Base-9.58bpw.gguf GGUF 9.99 GB Download
Qwen3.5-9B-Base-ddh0_v2-imatrix.gguf GGUF 4.91 MB Download
Qwen3.5-9B-ddh0_v2-imatrix.gguf GGUF 4.91 MB Download
mmproj-Qwen3.5-0.8B-f32.gguf GGUF F32 383.74 MB Download
mmproj-Qwen3.5-122B-A10B-Q8_0.gguf GGUF 590.53 MB Download
mmproj-Qwen3.5-122B-A10B-f32.gguf GGUF F32 1.68 GB Download
mmproj-Qwen3.5-27B-Q8_0.gguf GGUF 600.10 MB Download
mmproj-Qwen3.5-27B-f32.gguf GGUF F32 1.72 GB Download
mmproj-Qwen3.5-2B-Q8_0.gguf GGUF 347.77 MB Download
mmproj-Qwen3.5-2B-f32.gguf GGUF F32 1.23 GB Download
mmproj-Qwen3.5-35B-A3B-Q8_0.gguf GGUF 585.74 MB Download
mmproj-Qwen3.5-35B-A3B-f32.gguf GGUF F32 Unknown Download
mmproj-Qwen3.5-4B-Q8_0.gguf GGUF Unknown Download
mmproj-Qwen3.5-4B-f32.gguf GGUF F32 Unknown Download
mmproj-Qwen3.5-9B-Q8_0.gguf GGUF Unknown Download
mmproj-Qwen3.5-9B-f32.gguf GGUF F32 Unknown Download

Model Details Live

Model Slug
ddh0/qwen3.5-gguf
Author
ddh0
Pipeline Task
Library
Created
2026-02-25
Last Modified
2026-03-24
Gated
No
Private
No
HF SHA
a89fddc6c67e00cd3b429a19e30d59060503867c
License
Unknown
Language
Unknown
Base Model
Qwen/Qwen3.5-0.8B, Qwen/Qwen3.5-0.8B-Base, Qwen/Qwen3.5-2B, Qwen/Qwen3.5-2B-Base, Qwen/Qwen3.5-4B, Qwen/Qwen3.5-4B-Base, Qwen/Qwen3.5-9B, Qwen/Qwen3.5-9B-Base, Qwen/Qwen3.5-35B-A3B, Qwen/Qwen3.5-27B, Qwen/Qwen3.5-122B-A10B

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": [
      "Qwen/Qwen3.5-0.8B",
      "Qwen/Qwen3.5-0.8B-Base",
      "Qwen/Qwen3.5-2B",
      "Qwen/Qwen3.5-2B-Base",
      "Qwen/Qwen3.5-4B",
      "Qwen/Qwen3.5-4B-Base",
      "Qwen/Qwen3.5-9B",
      "Qwen/Qwen3.5-9B-Base",
      "Qwen/Qwen3.5-35B-A3B",
      "Qwen/Qwen3.5-27B",
      "Qwen/Qwen3.5-122B-A10B"
    ],
    "frontmatter": {
      "base_model": [
        "Qwen/Qwen3.5-0.8B",
        "Qwen/Qwen3.5-0.8B-Base",
        "Qwen/Qwen3.5-2B",
        "Qwen/Qwen3.5-2B-Base",
        "Qwen/Qwen3.5-4B",
        "Qwen/Qwen3.5-4B-Base",
        "Qwen/Qwen3.5-9B",
        "Qwen/Qwen3.5-9B-Base",
        "Qwen/Qwen3.5-35B-A3B",
        "Qwen/Qwen3.5-27B",
        "Qwen/Qwen3.5-122B-A10B"
      ]
    },
    "hero_image_url": "",
    "summary": "**Full suite of GGUF quantizations for the Qwen3.5 series.** Not including the 397B-A17B because it's too big for me to quant. See AesSedai/Qwen3.5-397B-A17B-GGUF for that one.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model:\n- Qwen/Qwen3.5-0.8B\n- Qwen/Qwen3.5-0.8B-Base\n- Qwen/Qwen3.5-2B\n- Qwen/Qwen3.5-2B-Base\n- Qwen/Qwen3.5-4B\n- Qwen/Qwen3.5-4B-Base\n- Qwen/Qwen3.5-9B\n- Qwen/Qwen3.5-9B-Base\n- Qwen/Qwen3.5-35B-A3B\n- Qwen/Qwen3.5-27B\n- Qwen/Qwen3.5-122B-A10B\n---\n\n**Full suite of GGUF quantizations for the Qwen3.5 series.**\n\nNot including the 397B-A17B because it's too big for me to quant. See [AesSedai/Qwen3.5-397B-A17B-GGUF](https://huggingface.co/AesSedai/Qwen3.5-397B-A17B-GGUF) for that one.",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "base_model:Qwen/Qwen3.5-0.8B",
    "base_model:quantized:Qwen/Qwen3.5-0.8B",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 3,
  "downloads": 10065,
  "gated": false,
  "private": false,
  "last_modified": "2026-03-24T05:49:25.000Z",
  "created_at": "2026-02-25T06:05:11.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "699e911749120d22597024df",
  "id": "ddh0/Qwen3.5-GGUF",
  "modelId": "ddh0/Qwen3.5-GGUF",
  "sha": "a89fddc6c67e00cd3b429a19e30d59060503867c",
  "createdAt": "2026-02-25T06:05:11.000Z",
  "lastModified": "2026-03-24T05:49:25.000Z",
  "author": "ddh0",
  "downloads": 10065,
  "likes": 3,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 54
}