afrideva/llama-3-yggdrasil-8b-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
afrideva/llama-3-yggdrasil-8b-gguf overview
Quantized GGUF model files for Llama-3-Yggdrasil-8B from Locutusque
Downloads
188
Likes
0
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
7 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| llama-3-yggdrasil-8b.Q2_K.gguf | GGUF | Q2_K | 2.96 GB | Download |
| llama-3-yggdrasil-8b.Q3_K_M.gguf | GGUF | Q3_K_M | 3.74 GB | Download |
| llama-3-yggdrasil-8b.Q4_K_M.gguf | GGUF | Q4_K_M | 4.58 GB | Download |
| llama-3-yggdrasil-8b.Q5_K_M.gguf | GGUF | Q5_K_M | 5.34 GB | Download |
| llama-3-yggdrasil-8b.Q6_K.gguf | GGUF | Q6_K | 6.14 GB | Download |
| llama-3-yggdrasil-8b.Q8_0.gguf | GGUF | — | 7.95 GB | Download |
| llama-3-yggdrasil-8b.fp16.gguf | GGUF | — | 14.97 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"base_model": "Locutusque/Llama-3-Yggdrasil-8B",
"inference": true,
"library_name": "transformers",
"license": "llama3",
"model_creator": "Locutusque",
"model_name": "Llama-3-Yggdrasil-8B",
"pipeline_tag": "text-generation",
"quantized_by": "afrideva",
"tags": [
"mergekit",
"merge",
"gguf",
"ggml",
"quantized"
],
"frontmatter": {
"base_model": "Locutusque/Llama-3-Yggdrasil-8B",
"inference": "true",
"library_name": "transformers",
"license": "llama3",
"model_creator": "Locutusque",
"model_name": "Llama-3-Yggdrasil-8B",
"pipeline_tag": "text-generation",
"quantized_by": "afrideva",
"tags": [
"mergekit",
"merge",
"gguf",
"ggml",
"quantized"
]
},
"hero_image_url": "",
"summary": "Quantized GGUF model files for Llama-3-Yggdrasil-8B from Locutusque",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nbase_model: Locutusque/Llama-3-Yggdrasil-8B\ninference: true\nlibrary_name: transformers\nlicense: llama3\nmodel_creator: Locutusque\nmodel_name: Llama-3-Yggdrasil-8B\npipeline_tag: text-generation\nquantized_by: afrideva\ntags:\n- mergekit\n- merge\n- gguf\n- ggml\n- quantized\n---\n\n# Llama-3-Yggdrasil-8B-GGUF\n\nQuantized GGUF model files for [Llama-3-Yggdrasil-8B](https://huggingface.co/Locutusque/Llama-3-Yggdrasil-8B) from [Locutusque](https://huggingface.co/Locutusque)\n\n## Original Model Card:\n\n# merge\n\nThis is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).\n\n## Merge Details\n### Merge Method\n\nThis model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [NousResearch/Meta-Llama-3-8B](https://huggingface.co/NousResearch/Meta-Llama-3-8B) as a base.\n\n### Models Merged\n\nThe following models were included in the merge:\n* [NousResearch/Meta-Llama-3-8B-Instruct](https://huggingface.co/NousResearch/Meta-Llama-3-8B-Instruct)\n* [Locutusque/Llama-3-Hercules-5.0-8B](https://huggingface.co/Locutusque/Llama-3-Hercules-5.0-8B)\n* [Locutusque/llama-3-neural-chat-v2.2-8b](https://huggingface.co/Locutusque/llama-3-neural-chat-v2.2-8b)\n\n### Configuration\n\nThe following YAML configuration was used to produce this model:\n\n```yaml\nmodels:\n - model: NousResearch/Meta-Llama-3-8B\n # No parameters necessary for base model\n - model: NousResearch/Meta-Llama-3-8B-Instruct\n parameters:\n density: 0.6\n weight: 0.55\n - model: Locutusque/llama-3-neural-chat-v2.2-8b\n parameters:\n density: 0.55\n weight: 0.45\n - model: Locutusque/Llama-3-Hercules-5.0-8B\n parameters:\n density: 0.57\n weight: 0.5\nmerge_method: dare_ties\nbase_model: NousResearch/Meta-Llama-3-8B\nparameters:\n int8_mask: true\ndtype: bfloat16\n\n```",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"mergekit",
"merge",
"ggml",
"quantized",
"text-generation",
"arxiv:2311.03099",
"arxiv:2306.01708",
"base_model:Locutusque/Llama-3-Yggdrasil-8B",
"base_model:quantized:Locutusque/Llama-3-Yggdrasil-8B",
"license:llama3",
"endpoints_compatible",
"region:us"
],
"likes": 0,
"downloads": 188,
"gated": false,
"private": false,
"last_modified": "2024-05-25T20:02:23.000Z",
"created_at": "2024-05-25T19:03:35.000Z",
"pipeline_tag": "text-generation",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "66523607da1c9a23c68d7be2",
"id": "afrideva/Llama-3-Yggdrasil-8B-GGUF",
"modelId": "afrideva/Llama-3-Yggdrasil-8B-GGUF",
"sha": "54a217faebf9005b779af75697df66f55126da29",
"createdAt": "2024-05-25T19:03:35.000Z",
"lastModified": "2024-05-25T20:02:23.000Z",
"author": "afrideva",
"downloads": 188,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "transformers",
"siblings_count": 9
}