seyf1elislam/llama3-openhermes-2.5-gguf overview

{
  "metadata": {},
  "card_data": {
    "tags": [
      "GGUF"
    ],
    "base_model": [
      "sumandas/llama3-openhermes-2.5"
    ],
    "frontmatter": {
      "tags": [
        "GGUF"
      ],
      "base_model": [
        "sumandas/llama3-openhermes-2.5"
      ]
    },
    "hero_image_url": "",
    "summary": "# llama3-openhermes-2.5",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\ntags:\n- GGUF\nbase_model:\n- sumandas/llama3-openhermes-2.5\n---\n# llama3-openhermes-2.5\n- Model creator: [sumandas](https://huggingface.co/sumandas)\n- Original model: [llama3-openhermes-2.5](https://huggingface.co/sumandas/llama3-openhermes-2.5)\n\n<!-- description start -->\n## Description\nThis repo contains GGUF format model files for [sumandas's llama3-openhermes-2.5 ](https://huggingface.co/sumandas/llama3-openhermes-2.5).\n\n## Provided files\n\n| Name | Quant method | Bits | Size | Max RAM required | Use case |\n| ---- | ---- | ---- | ---- | ---- | ----- |\n| [llama3-openhermes-2.5.Q2_K.gguf   ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q2_K.gguf   ) | Q2_K   | 2 | 2.72 GB| 5.22 GB | significant quality loss - not recommended for most purposes |\n| [llama3-openhermes-2.5.Q3_K_M.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q3_K_M.gguf ) | Q3_K_M | 3 | 3.52 GB| 6.02 GB | very small, high quality loss |\n| [llama3-openhermes-2.5.Q4_K_S.gguf           ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q4_K_S.gguf           ) | Q4_K_S | 4 | 4.14 GB| 6.64 GB | small, greater quality loss |\n| [llama3-openhermes-2.5.Q4_K_M.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q4_K_M.gguf ) | Q4_K_M | 4 | 4.37 GB| 6.87 GB | medium, balanced quality - recommended |\n| [llama3-openhermes-2.5.Q5_K_M.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q5_K_M.gguf ) | Q5_K_M | 5 | 5.13 GB| 7.63 GB | large, very low quality loss - recommended |\n| [llama3-openhermes-2.5.Q6_K.gguf   ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q6_K.gguf   ) | Q6_K   | 6 | 5.94 GB| 8.44 GB | very large, extremely low quality loss |\n| [llama3-openhermes-2.5.Q8_0.gguf   ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q8_0.gguf   ) | Q8_0   | 8 | 7.70 GB| 10.20 GB | very large, extremely low quality loss - not recommended |",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "GGUF",
    "base_model:sumandas/llama3-openhermes-2.5",
    "base_model:quantized:sumandas/llama3-openhermes-2.5",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 88,
  "gated": false,
  "private": false,
  "last_modified": "2024-04-21T16:50:30.000Z",
  "created_at": "2024-04-21T14:00:19.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66251bf30d4d07946f6c5ebb",
  "id": "seyf1elislam/llama3-openhermes-2.5-GGUF",
  "modelId": "seyf1elislam/llama3-openhermes-2.5-GGUF",
  "sha": "05603d645f538ef714f7756219d8fdeb8a26534a",
  "createdAt": "2024-04-21T14:00:19.000Z",
  "lastModified": "2024-04-21T16:50:30.000Z",
  "author": "seyf1elislam",
  "downloads": 88,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 8
}