afrideva/tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco-gguf guanaco.q8_0 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
afrideva/tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco-gguf overview
jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF Quantized GGUF model files for TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco from jncraton | Name | Quant method | Size | | ---- | ---- | ---- | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q2k.gguf | q2k | 482.14 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q3km.gguf | q3km | 549.85 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q4km.gguf | q4km | 667.81 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q5km.gguf | q5km | 782.04 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q6k.gguf | q6k | 903.41 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q80.gguf | q80 | 1.17 GB |
Downloads
115
Likes
0
Pipeline
text-generation
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
7 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.fp16.gguf | GGUF | — | 2.05 GB | Download |
| tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q2_k.gguf | GGUF | Q2_K | 459.81 MB | Download |
| tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q3_k_m.gguf | GGUF | Q3_K_M | 524.37 MB | Download |
| tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q4_k_m.gguf | GGUF | Q4_K_M | 636.88 MB | Download |
| tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q5_k_m.gguf | GGUF | Q5_K_M | 745.81 MB | Download |
| tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q6_k.gguf | GGUF | Q6_K | 861.56 MB | Download |
| tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q8_0.gguf | GGUF | — | 1.09 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"base_model": "jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco",
"inference": false,
"model_creator": "jncraton",
"model_name": "TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco",
"pipeline_tag": "text-generation",
"quantized_by": "afrideva",
"tags": [
"gguf",
"ggml",
"quantized",
"q2_k",
"q3_k_m",
"q4_k_m",
"q5_k_m",
"q6_k",
"q8_0"
],
"frontmatter": {
"base_model": "jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco",
"inference": "false",
"model_creator": "jncraton",
"model_name": "TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco",
"pipeline_tag": "text-generation",
"quantized_by": "afrideva",
"tags": [
"gguf",
"ggml",
"quantized",
"q2_k",
"q3_k_m",
"q4_k_m",
"q5_k_m",
"q6_k",
"q8_0"
]
},
"hero_image_url": "",
"summary": "# jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF Quantized GGUF model files for TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco from jncraton | Name | Quant method | Size | | ---- | ---- | ---- | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q2_k.gguf | q2_k | 482.14 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q3_k_m.gguf | q3_k_m | 549.85 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q4_k_m.gguf | q4_k_m | 667.81 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q5_k_m.gguf | q5_k_m | 782.04 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q6_k.gguf | q6_k | 903.41 MB | | tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q8_0.gguf | q8_0 | 1.17 GB |",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nbase_model: jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco\ninference: false\nmodel_creator: jncraton\nmodel_name: TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco\npipeline_tag: text-generation\nquantized_by: afrideva\ntags:\n- gguf\n- ggml\n- quantized\n- q2_k\n- q3_k_m\n- q4_k_m\n- q5_k_m\n- q6_k\n- q8_0\n---\n# jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF\n\nQuantized GGUF model files for [TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco](https://huggingface.co/jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco) from [jncraton](https://huggingface.co/jncraton)\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q2_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q2_k.gguf) | q2_k | 482.14 MB |\n| [tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q3_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q3_k_m.gguf) | q3_k_m | 549.85 MB |\n| [tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q4_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q4_k_m.gguf) | q4_k_m | 667.81 MB |\n| [tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q5_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q5_k_m.gguf) | q5_k_m | 782.04 MB |\n| [tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q6_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q6_k.gguf) | q6_k | 903.41 MB |\n| [tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q8_0.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t-guanaco.q8_0.gguf) | q8_0 | 1.17 GB |\n\n\n\n## Original Model Card:\n",
"related_quantizations": []
},
"tags": [
"gguf",
"ggml",
"quantized",
"q2_k",
"q3_k_m",
"q4_k_m",
"q5_k_m",
"q6_k",
"q8_0",
"text-generation",
"base_model:jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco",
"base_model:quantized:jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco",
"region:us"
],
"likes": 0,
"downloads": 115,
"gated": false,
"private": false,
"last_modified": "2023-11-19T22:14:12.000Z",
"created_at": "2023-11-19T21:49:53.000Z",
"pipeline_tag": "text-generation",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "655a83016412aaeed67dde34",
"id": "afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF",
"modelId": "afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco-GGUF",
"sha": "27c57a5c6c9efe95e6319f19b9308177a0d8d17f",
"createdAt": "2023-11-19T21:49:53.000Z",
"lastModified": "2023-11-19T22:14:12.000Z",
"author": "afrideva",
"downloads": 115,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "",
"siblings_count": 9
}