richarderkhov/juvi21_-_hermes-2-theta-l3-euryale-ties-0.8-70b-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "",
    "summary": "This is a merge of pre-trained language models created using mergekit. I wanted to have enhanced roleplay performance and merged two of my favorite models together. I maybe release some merges like this with different methods and biases. This config seemed to be the best mix of both world on first glance. I will update my experiences further in the future.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nHermes-2-Theta-L3-Euryale-Ties-0.8-70B - GGUF\n- Model creator: https://huggingface.co/juvi21/\n- Original model: https://huggingface.co/juvi21/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q2_K.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q2_K.gguf) | Q2_K | 24.56GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.IQ3_XS.gguf) | IQ3_XS | 27.29GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.IQ3_S.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.IQ3_S.gguf) | IQ3_S | 28.79GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q3_K_S.gguf) | Q3_K_S | 28.79GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.IQ3_M.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.IQ3_M.gguf) | IQ3_M | 29.74GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q3_K.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q3_K.gguf) | Q3_K | 31.91GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q3_K_M.gguf) | Q3_K_M | 31.91GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q3_K_L.gguf) | Q3_K_L | 34.59GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.IQ4_XS.gguf) | IQ4_XS | 35.64GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q4_0.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/blob/main/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q4_0.gguf) | Q4_0 | 37.22GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | IQ4_NL | 37.58GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q4_K_S | 37.58GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q4_K.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q4_K | 39.6GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q4_K_M | 39.6GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q4_1.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q4_1 | 41.27GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q5_0.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q5_0 | 45.32GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q5_K_S | 45.32GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q5_K.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q5_K | 46.52GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q5_K_M | 46.52GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q5_1.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q5_1 | 49.36GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q6_K.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q6_K | 53.91GB |\n| [Hermes-2-Theta-L3-Euryale-Ties-0.8-70B.Q8_0.gguf](https://huggingface.co/RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf/tree/main/) | Q8_0 | 69.83GB |\n\n\n\n\nOriginal model description:\n---\nbase_model:\n- Sao10K/L3-70B-Euryale-v2.1\n- NousResearch/Hermes-2-Theta-Llama-3-70B\nlibrary_name: transformers\ntags:\n- mergekit\n- merge\n\n---\n# Hermes-2-Theta-L3-Euryale-Ties-0.8-70B\n\nThis is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). \nI wanted to have enhanced roleplay performance and merged two of my favorite models together. I maybe release some merges like this with different methods and biases. This config seemed to be the best mix of both world on first glance. \nI will update my experiences further in the future.\n\n## Merge Details\n### Merge Method\n\nThis model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [NousResearch/Hermes-2-Theta-Llama-3-70B](https://huggingface.co/NousResearch/Hermes-2-Theta-Llama-3-70B) as a base.\n\n### Models Merged\n\nThe following models were included in the merge:\n* [Sao10K/L3-70B-Euryale-v2.1](https://huggingface.co/Sao10K/L3-70B-Euryale-v2.1)\n\n### Configuration\n\nThe following YAML configuration was used to produce this model:\n\n```yaml\nmodels:\n  - model: NousResearch/Hermes-2-Theta-Llama-3-70B\n    parameters:\n      weight: 0.8\n  - model: Sao10K/L3-70B-Euryale-v2.1\n    parameters:\n      weight: 0.2\nmerge_method: ties\nbase_model: NousResearch/Hermes-2-Theta-Llama-3-70B\nparameters:\n  density: 0.7\n  normalize: true\ndtype: float16\ntokenizer_source: base\n\n```\n\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "arxiv:2306.01708",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 2021,
  "gated": false,
  "private": false,
  "last_modified": "2024-09-08T18:48:16.000Z",
  "created_at": "2024-09-07T22:52:59.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66dcd94b9da9840bf4c90580",
  "id": "RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf",
  "modelId": "RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf",
  "sha": "94067282de5d43d0e16f4caf77cbf222f974ffe8",
  "createdAt": "2024-09-07T22:52:59.000Z",
  "lastModified": "2024-09-08T18:48:16.000Z",
  "author": "RichardErkhov",
  "downloads": 2021,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 36
}