llmware/qwen2.5-7b-coder-gguf - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
llmware/qwen2.5-7b-coder-gguf overview
qwen2.5-coder-7b-instruct-gguf is a GGUF Q4KM int4 quantized version of Qwen2.5-Coder-7B-Instruct, providing a fast inference implementation, optimized for AI PCs. This is from the latest release series from Qwen, and is an excellent chat/instruct coding assistant model. ### Model Description
Downloads
137
Likes
0
Pipeline
—
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
1 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen2.5.1-Coder-7B-Instruct-Q4_K_M.gguf | GGUF | Q4_K_M | 4.36 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"inference": false,
"base_model": "Qwen/Qwen2.5-Coder-7B-Instruct",
"base_model_relation": "quantized",
"tags": [
"green",
"llmware-chat",
"p7",
"gguf",
"emerald"
],
"frontmatter": {
"license": "apache-2.0",
"inference": "false",
"base_model": "Qwen/Qwen2.5-Coder-7B-Instruct",
"base_model_relation": "quantized",
"tags": "[green, llmware-chat, p7, gguf, emerald]"
},
"hero_image_url": "",
"summary": "**qwen2.5-coder-7b-instruct-gguf** is a GGUF Q4_K_M int4 quantized version of Qwen2.5-Coder-7B-Instruct, providing a fast inference implementation, optimized for AI PCs. This is from the latest release series from Qwen, and is an excellent chat/instruct coding assistant model. ### Model Description",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\ninference: false \nbase_model: Qwen/Qwen2.5-Coder-7B-Instruct\nbase_model_relation: quantized \ntags: [green, llmware-chat, p7, gguf, emerald]\n---\n\n# qwen2.5-coder-7b-instruct-gguf\n\n**qwen2.5-coder-7b-instruct-gguf** is a GGUF Q4_K_M int4 quantized version of [Qwen2.5-Coder-7B-Instruct](https://www.huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct), providing a fast inference implementation, optimized for AI PCs. \n\nThis is from the latest release series from Qwen, and is an excellent chat/instruct coding assistant model. \n\n### Model Description\n\n- **Developed by:** Qwen\n- **Quantized by:** llmware \n- **Model type:** qwen2.5\n- **Parameters:** 7 billion \n- **Model Parent:** Qwen/Qwen2.5-Coder-7B-Instruct \n- **Language(s) (NLP):** English \n- **License:** Apache 2.0 \n- **Uses:** Chat, general-purpose LLM \n- **Quantization:** int4 \n \n\n## Model Card Contact \n\n[llmware on github](https://www.github.com/llmware-ai/llmware) \n\n[llmware on hf](https://www.huggingface.co/llmware) \n\n[llmware website](https://www.llmware.ai) \n",
"related_quantizations": []
},
"tags": [
"gguf",
"qwen2",
"green",
"llmware-chat",
"p7",
"emerald",
"base_model:Qwen/Qwen2.5-Coder-7B-Instruct",
"base_model:quantized:Qwen/Qwen2.5-Coder-7B-Instruct",
"license:apache-2.0",
"region:us",
"imatrix",
"conversational"
],
"likes": 0,
"downloads": 137,
"gated": false,
"private": false,
"last_modified": "2025-02-08T23:32:51.000Z",
"created_at": "2025-01-13T18:20:03.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "6785595388db4a8e1de4ad3b",
"id": "llmware/qwen2.5-7b-coder-gguf",
"modelId": "llmware/qwen2.5-7b-coder-gguf",
"sha": "06ed879ea9e8bb504c7af25c0b1b3db7aac8b5a6",
"createdAt": "2025-01-13T18:20:03.000Z",
"lastModified": "2025-02-08T23:32:51.000Z",
"author": "llmware",
"downloads": 137,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 5
}