llmware/tiny-llama-chat-gguf - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
llmware/tiny-llama-chat-gguf overview
tiny-llama-chat-gguf is an GGUF Q4KM int4 quantized version of TinyLlama-Chat, providing a very fast, very small inference implementation, optimized for AI PCs. tiny-llama-chat is the official chat finetuned version of tiny-llama. ### Model Description
Downloads
285
Likes
1
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
1 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| tiny-llama-chat.gguf | GGUF | — | 636.88 MB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"inference": false,
"base_model": "TinyLlama/TinyLlama-1.1B-Chat-v1.0",
"base_model_relation": "quantized",
"tags": [
"green",
"llmware-chat",
"p1",
"gguf",
"emerald"
],
"frontmatter": {
"license": "apache-2.0",
"inference": "false",
"base_model": "TinyLlama/TinyLlama-1.1B-Chat-v1.0",
"base_model_relation": "quantized",
"tags": [
"green",
"llmware-chat",
"p1",
"gguf",
"emerald"
]
},
"hero_image_url": "",
"summary": "**tiny-llama-chat-gguf** is an GGUF Q4_K_M int4 quantized version of TinyLlama-Chat, providing a very fast, very small inference implementation, optimized for AI PCs. **tiny-llama-chat** is the official chat finetuned version of tiny-llama. ### Model Description",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\ninference: false\nbase_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0 \nbase_model_relation: quantized \ntags:\n- green\n- llmware-chat\n- p1\n- gguf\n- emerald\n---\n\n# tiny-llama-chat-gguf\n\n**tiny-llama-chat-gguf** is an GGUF Q4_K_M int4 quantized version of TinyLlama-Chat, providing a very fast, very small inference implementation, optimized for AI PCs. \n\n[**tiny-llama-chat**](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) is the official chat finetuned version of tiny-llama. \n\n\n### Model Description\n\n- **Developed by:** TinyLlama\n- **Quantized by:** llmware \n- **Model type:** llama\n- **Parameters:** 1.1 billion\n- **Model Parent:** TinyLlama-1.1B-Chat-v1.0 \n- **Language(s) (NLP):** English \n- **License:** Apache 2.0 \n- **Uses:** Chat and general purpose LLM\n- **RAG Benchmark Accuracy Score:** NA \n- **Quantization:** int4 \n \n\n## Model Card Contact\n\n[llmware on github](https://www.github.com/llmware-ai/llmware) \n\n[llmware on hf](https://www.huggingface.co/llmware) \n\n[llmware website](https://www.llmware.ai)",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"llama",
"text-generation",
"green",
"llmware-chat",
"p1",
"emerald",
"base_model:TinyLlama/TinyLlama-1.1B-Chat-v1.0",
"base_model:quantized:TinyLlama/TinyLlama-1.1B-Chat-v1.0",
"license:apache-2.0",
"region:us",
"conversational"
],
"likes": 1,
"downloads": 285,
"gated": false,
"private": false,
"last_modified": "2025-02-08T23:16:59.000Z",
"created_at": "2024-05-11T12:46:40.000Z",
"pipeline_tag": "text-generation",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "663f68b08732bcd0766c9c53",
"id": "llmware/tiny-llama-chat-gguf",
"modelId": "llmware/tiny-llama-chat-gguf",
"sha": "18369068f6ae8b2d5d6cb4ecb1be643817df92e4",
"createdAt": "2024-05-11T12:46:40.000Z",
"lastModified": "2025-02-08T23:16:59.000Z",
"author": "llmware",
"downloads": 285,
"likes": 1,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "transformers",
"siblings_count": 5
}