llmware/llama-3.2-1b-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
llmware/llama-3.2-1b-gguf overview
llama-3.2-1b-instruct-gguf is a GGUF Q4KM int4 quantized version of Llama 3.2 1B Instruct, providing a very small, very fast inference implementation, optimized for AI PCs. llama-3.2-1b-instruct is a new 1B chat foundation model from Meta. ### Model Description
Downloads
160
Likes
1
Pipeline
—
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
1 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Llama-3.2-1B-Instruct-Q4_K_M.gguf | GGUF | Q4_K_M | 770.28 MB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "llama3.2",
"inference": false,
"base_model": "meta-llama/Llama-3.2-1B-Instruct",
"base_model_relation": "quantized",
"tags": [
"green",
"p1",
"llmware-chat",
"gguf",
"emerald"
],
"frontmatter": {
"license": "llama3.2",
"inference": "false",
"base_model": "meta-llama/Llama-3.2-1B-Instruct",
"base_model_relation": "quantized",
"tags": [
"green",
"p1",
"llmware-chat",
"gguf",
"emerald"
]
},
"hero_image_url": "",
"summary": "**llama-3.2-1b-instruct-gguf** is a GGUF Q4_K_M int4 quantized version of Llama 3.2 1B Instruct, providing a very small, very fast inference implementation, optimized for AI PCs. **llama-3.2-1b-instruct** is a new 1B chat foundation model from Meta. ### Model Description",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: llama3.2\ninference: false\nbase_model: meta-llama/Llama-3.2-1B-Instruct\nbase_model_relation: quantized\ntags:\n- green\n- p1\n- llmware-chat\n- gguf\n- emerald\n---\n\n# llama-3.2-1b-instruct-gguf\n\n**llama-3.2-1b-instruct-gguf** is a GGUF Q4_K_M int4 quantized version of Llama 3.2 1B Instruct, providing a very small, very fast inference implementation, optimized for AI PCs. \n\n[**llama-3.2-1b-instruct**](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) is a new 1B chat foundation model from Meta. \n\n\n### Model Description\n\n- **Developed by:** meta-llama\n- **Quantized by:** llmware\n- **Model type:** llama-3.2 \n- **Parameters:** 1 billion\n- **Model Parent:** meta-llama/Meta-Llama-3.2-1B-Instruct \n- **Language(s) (NLP):** English \n- **License:** Llama 3.2 Community License\n- **Uses:** General chat use cases \n- **RAG Benchmark Accuracy Score:** NA \n- **Quantization:** int4 \n \n\n## Model Card Contact\n\n[llmware on github](https://www.github.com/llmware-ai/llmware) \n\n[llmware on hf](https://www.huggingface.co/llmware) \n\n[llmware website](https://www.llmware.ai)",
"related_quantizations": []
},
"tags": [
"gguf",
"llama",
"green",
"p1",
"llmware-chat",
"emerald",
"base_model:meta-llama/Llama-3.2-1B-Instruct",
"base_model:quantized:meta-llama/Llama-3.2-1B-Instruct",
"license:llama3.2",
"region:us",
"imatrix",
"conversational"
],
"likes": 1,
"downloads": 160,
"gated": false,
"private": false,
"last_modified": "2025-02-08T23:22:40.000Z",
"created_at": "2025-01-13T17:56:18.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "678553c2c3b883cd1ab6987c",
"id": "llmware/llama-3.2-1b-gguf",
"modelId": "llmware/llama-3.2-1b-gguf",
"sha": "791d0a871ed5d41cba95028d8393c726a03791ad",
"createdAt": "2025-01-13T17:56:18.000Z",
"lastModified": "2025-02-08T23:22:40.000Z",
"author": "llmware",
"downloads": 160,
"likes": 1,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 5
}