llmware/qwen-3.5-4b-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
llmware/qwen-3.5-4b-gguf overview
qwen3.5-4b-gguf is a GGUF Q4KM int4 quantized version of Qwen3.5-4B, providing a very fast inference implementation, optimized for AI PCs. ### Model Description
Downloads
122
Likes
0
Pipeline
—
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
1 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-4B-Q4_K_M.gguf | GGUF | Q4_K_M | 2.55 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"inference": false,
"base_model": "Qwen/Qwen3.5-4B",
"base_model_relation": "quantized",
"tags": [
"green",
"llmware-chat",
"p4",
"gguf",
"emerald"
],
"frontmatter": {
"license": "apache-2.0",
"inference": "false",
"base_model": "Qwen/Qwen3.5-4B",
"base_model_relation": "quantized",
"tags": "[green, llmware-chat, p4, gguf,emerald]"
},
"hero_image_url": "",
"summary": "**qwen3.5-4b-gguf** is a GGUF Q4_K_M int4 quantized version of Qwen3.5-4B, providing a very fast inference implementation, optimized for AI PCs. ### Model Description",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\ninference: false \nbase_model: Qwen/Qwen3.5-4B\nbase_model_relation: quantized \ntags: [green, llmware-chat, p4, gguf,emerald]\n---\n\n# qwen3.5-4b-gguf\n\n**qwen3.5-4b-gguf** is a GGUF Q4_K_M int4 quantized version of [Qwen3.5-4B](https://www.huggingface.co/Qwen/Qwen3.5-4B), providing a very fast inference implementation, optimized for AI PCs. \n\n### Model Description\n\n- **Developed by:** Qwen\n- **Model type:** qwen3.5\n- **Parameters:** 4 billion \n- **Model Parent:** Qwen/Qwen3.5-4B \n- **Language(s) (NLP):** English \n- **License:** Apache 2.0 \n- **Uses:** Chat, general-purpose LLM \n- **Quantization:** int4 \n \n\n## Model Card Contact \n\n[llmware on github](https://www.github.com/llmware-ai/llmware) \n\n[llmware on hf](https://www.huggingface.co/llmware) \n\n[llmware website](https://www.llmware.ai) \n",
"related_quantizations": []
},
"tags": [
"gguf",
"qwen3_5",
"green",
"llmware-chat",
"p4",
"emerald",
"base_model:Qwen/Qwen3.5-4B",
"base_model:quantized:Qwen/Qwen3.5-4B",
"license:apache-2.0",
"region:us",
"imatrix",
"conversational"
],
"likes": 0,
"downloads": 122,
"gated": false,
"private": false,
"last_modified": "2026-03-31T08:39:03.000Z",
"created_at": "2026-03-20T21:41:24.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "69bdbf04046cd4daeb5954e7",
"id": "llmware/qwen-3.5-4b-gguf",
"modelId": "llmware/qwen-3.5-4b-gguf",
"sha": "850e2522ddadb6fc0879737ebe1670bc233ab9ee",
"createdAt": "2026-03-20T21:41:24.000Z",
"lastModified": "2026-03-31T08:39:03.000Z",
"author": "llmware",
"downloads": 122,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 5
}