GraySoft
Projects Models About FAQ Contact Download guIDE →

afrideva/llama-3-yggdrasil-8b-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

afrideva/llama-3-yggdrasil-8b-gguf overview

Quantized GGUF model files for Llama-3-Yggdrasil-8B from Locutusque

transformersggufmergekitmergeggmlquantizedtext-generationarxiv:2311.03099arxiv:2306.01708base_model:Locutusque/Llama-3-Yggdrasil-8Bbase_model:quantized:Locutusque/Llama-3-Yggdrasil-8Blicense:llama3endpoints_compatibleregion:us
afrideva/llama-3-yggdrasil-8b-gguf visual
Downloads
188
Likes
0
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

7 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
llama-3-yggdrasil-8b.Q2_K.gguf GGUF Q2_K 2.96 GB Download
llama-3-yggdrasil-8b.Q3_K_M.gguf GGUF Q3_K_M 3.74 GB Download
llama-3-yggdrasil-8b.Q4_K_M.gguf GGUF Q4_K_M 4.58 GB Download
llama-3-yggdrasil-8b.Q5_K_M.gguf GGUF Q5_K_M 5.34 GB Download
llama-3-yggdrasil-8b.Q6_K.gguf GGUF Q6_K 6.14 GB Download
llama-3-yggdrasil-8b.Q8_0.gguf GGUF 7.95 GB Download
llama-3-yggdrasil-8b.fp16.gguf GGUF 14.97 GB Download

Model Details Live

Model Slug
afrideva/llama-3-yggdrasil-8b-gguf
Author
afrideva
Pipeline Task
text-generation
Library
transformers
Created
2024-05-25
Last Modified
2024-05-25
Gated
No
Private
No
HF SHA
54a217faebf9005b779af75697df66f55126da29
License
llama3
Language
Unknown
Base Model
Locutusque/Llama-3-Yggdrasil-8B

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": "Locutusque/Llama-3-Yggdrasil-8B",
    "inference": true,
    "library_name": "transformers",
    "license": "llama3",
    "model_creator": "Locutusque",
    "model_name": "Llama-3-Yggdrasil-8B",
    "pipeline_tag": "text-generation",
    "quantized_by": "afrideva",
    "tags": [
      "mergekit",
      "merge",
      "gguf",
      "ggml",
      "quantized"
    ],
    "frontmatter": {
      "base_model": "Locutusque/Llama-3-Yggdrasil-8B",
      "inference": "true",
      "library_name": "transformers",
      "license": "llama3",
      "model_creator": "Locutusque",
      "model_name": "Llama-3-Yggdrasil-8B",
      "pipeline_tag": "text-generation",
      "quantized_by": "afrideva",
      "tags": [
        "mergekit",
        "merge",
        "gguf",
        "ggml",
        "quantized"
      ]
    },
    "hero_image_url": "",
    "summary": "Quantized GGUF model files for Llama-3-Yggdrasil-8B from Locutusque",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: Locutusque/Llama-3-Yggdrasil-8B\ninference: true\nlibrary_name: transformers\nlicense: llama3\nmodel_creator: Locutusque\nmodel_name: Llama-3-Yggdrasil-8B\npipeline_tag: text-generation\nquantized_by: afrideva\ntags:\n- mergekit\n- merge\n- gguf\n- ggml\n- quantized\n---\n\n# Llama-3-Yggdrasil-8B-GGUF\n\nQuantized GGUF model files for [Llama-3-Yggdrasil-8B](https://huggingface.co/Locutusque/Llama-3-Yggdrasil-8B) from [Locutusque](https://huggingface.co/Locutusque)\n\n## Original Model Card:\n\n# merge\n\nThis is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).\n\n## Merge Details\n### Merge Method\n\nThis model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [NousResearch/Meta-Llama-3-8B](https://huggingface.co/NousResearch/Meta-Llama-3-8B) as a base.\n\n### Models Merged\n\nThe following models were included in the merge:\n* [NousResearch/Meta-Llama-3-8B-Instruct](https://huggingface.co/NousResearch/Meta-Llama-3-8B-Instruct)\n* [Locutusque/Llama-3-Hercules-5.0-8B](https://huggingface.co/Locutusque/Llama-3-Hercules-5.0-8B)\n* [Locutusque/llama-3-neural-chat-v2.2-8b](https://huggingface.co/Locutusque/llama-3-neural-chat-v2.2-8b)\n\n### Configuration\n\nThe following YAML configuration was used to produce this model:\n\n```yaml\nmodels:\n  - model: NousResearch/Meta-Llama-3-8B\n    # No parameters necessary for base model\n  - model: NousResearch/Meta-Llama-3-8B-Instruct\n    parameters:\n      density: 0.6\n      weight: 0.55\n  - model: Locutusque/llama-3-neural-chat-v2.2-8b\n    parameters:\n      density: 0.55\n      weight: 0.45\n  - model: Locutusque/Llama-3-Hercules-5.0-8B\n    parameters:\n      density: 0.57\n      weight: 0.5\nmerge_method: dare_ties\nbase_model: NousResearch/Meta-Llama-3-8B\nparameters:\n  int8_mask: true\ndtype: bfloat16\n\n```",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "mergekit",
    "merge",
    "ggml",
    "quantized",
    "text-generation",
    "arxiv:2311.03099",
    "arxiv:2306.01708",
    "base_model:Locutusque/Llama-3-Yggdrasil-8B",
    "base_model:quantized:Locutusque/Llama-3-Yggdrasil-8B",
    "license:llama3",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 0,
  "downloads": 188,
  "gated": false,
  "private": false,
  "last_modified": "2024-05-25T20:02:23.000Z",
  "created_at": "2024-05-25T19:03:35.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "66523607da1c9a23c68d7be2",
  "id": "afrideva/Llama-3-Yggdrasil-8B-GGUF",
  "modelId": "afrideva/Llama-3-Yggdrasil-8B-GGUF",
  "sha": "54a217faebf9005b779af75697df66f55126da29",
  "createdAt": "2024-05-25T19:03:35.000Z",
  "lastModified": "2024-05-25T20:02:23.000Z",
  "author": "afrideva",
  "downloads": 188,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 9
}