llmware/qwen3-8b-gguf - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
llmware/qwen3-8b-gguf overview
qwen3-8b-instruct-gguf is a GGUF Q4KM int4 quantized version of Qwen3-8B, providing a very fast inference implementation, optimized for AI PCs. ### Model Description
Downloads
106
Likes
0
Pipeline
—
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
1 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3-8B-Q4_K_M.gguf | GGUF | Q4_K_M | 4.68 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"inference": false,
"base_model": "Qwen/Qwen3-8B-Instruct",
"base_model_relation": "quantized",
"tags": [
"green",
"llmware-chat",
"p8",
"gguf",
"emerald"
],
"frontmatter": {
"license": "apache-2.0",
"inference": "false",
"base_model": "Qwen/Qwen3-8B-Instruct",
"base_model_relation": "quantized",
"tags": "[green, llmware-chat, p8, gguf,emerald]"
},
"hero_image_url": "",
"summary": "**qwen3-8b-instruct-gguf** is a GGUF Q4_K_M int4 quantized version of Qwen3-8B, providing a very fast inference implementation, optimized for AI PCs. ### Model Description",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\ninference: false \nbase_model: Qwen/Qwen3-8B-Instruct\nbase_model_relation: quantized \ntags: [green, llmware-chat, p8, gguf,emerald]\n---\n\n# qwen3-8b-instruct-gguf\n\n**qwen3-8b-instruct-gguf** is a GGUF Q4_K_M int4 quantized version of [Qwen3-8B](https://www.huggingface.co/Qwen/Qwen3-8B), providing a very fast inference implementation, optimized for AI PCs. \n\n### Model Description\n\n- **Developed by:** Qwen\n- **Model type:** qwen3\n- **Parameters:** 8 billion \n- **Model Parent:** Qwen/Qwen3-8B \n- **Language(s) (NLP):** English \n- **License:** Apache 2.0 \n- **Uses:** Chat, general-purpose LLM \n- **Quantization:** int4 \n \n\n## Model Card Contact \n\n[llmware on github](https://www.github.com/llmware-ai/llmware) \n\n[llmware on hf](https://www.huggingface.co/llmware) \n\n[llmware website](https://www.llmware.ai) \n",
"related_quantizations": []
},
"tags": [
"gguf",
"qwen3",
"green",
"llmware-chat",
"p8",
"emerald",
"license:apache-2.0",
"region:us",
"conversational"
],
"likes": 0,
"downloads": 106,
"gated": false,
"private": false,
"last_modified": "2025-07-05T21:48:09.000Z",
"created_at": "2025-07-05T15:30:46.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "68694526f47ca625bcff5b6d",
"id": "llmware/qwen3-8b-gguf",
"modelId": "llmware/qwen3-8b-gguf",
"sha": "dfef362b3b5e5f2d9059b2d03b67ae39a3bbf7f1",
"createdAt": "2025-07-05T15:30:46.000Z",
"lastModified": "2025-07-05T21:48:09.000Z",
"author": "llmware",
"downloads": 106,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 6
}