lewdiculous/eris-daturamix-7b-gguf-iq-imatrix overview

{
  "metadata": {},
  "card_data": {
    "library_name": "transformers",
    "license": "other",
    "datasets": [
      "athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED",
      "ResplendentAI/Synthetic_Soul_1k"
    ],
    "language": [
      "en"
    ],
    "tags": [
      "mistral",
      "merge"
    ],
    "inference": false,
    "frontmatter": {
      "library_name": "transformers",
      "license": "other",
      "datasets": [
        "athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED",
        "ResplendentAI/Synthetic_Soul_1k"
      ],
      "language": [
        "en"
      ],
      "tags": [
        "mistral",
        "merge"
      ],
      "inference": "false"
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/FtEEuyGni5M-cxkYYBBHw.jpeg",
    "summary": "This repository hosts GGUF-Imatrix quantizations for Test157t/Eris-Daturamix-7b. `` Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants) ` `python quantization_options = [ \"Q4_K_M\", \"IQ4_XS\", \"Q5_K_M\", \"Q6_K\", \"Q8_0\", \"IQ3_M\", \"IQ3_S\", \"IQ3_XXS\" ] ` **Relevant information:** For imatrix data generation, kalomaze's groups_merged.txt with added roleplay chats was used, you can find it here. There's already a **v2** of this model here. **Original model information:** !image/jpeg The following models were included in the merge: * ResplendentAI/Datura_7B * Test157t/Eris-Floramix-7b ### Configuration `yaml slices: layer_range: [0, 32] layer_range: [0, 32] merge_method: slerp base_model: Test157t/Eris-Floramix-7b parameters: t: value: [1, 0.5, 0.7, 0.3, 0] dtype: bfloat16 ``",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlibrary_name: transformers\nlicense: other\ndatasets:\n- athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED\n- ResplendentAI/Synthetic_Soul_1k\nlanguage:\n- en\ntags:\n- mistral\n- merge\ninference: false\n\n\n\n---\n\nThis repository hosts GGUF-Imatrix quantizations for [Test157t/Eris-Daturamix-7b](https://huggingface.co/Test157t/Eris-Daturamix-7b).\n```\nBase⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)\n```\n\n```python\n    quantization_options = [\n        \"Q4_K_M\", \"IQ4_XS\", \"Q5_K_M\", \"Q6_K\",\n        \"Q8_0\", \"IQ3_M\", \"IQ3_S\", \"IQ3_XXS\"\n    ]\n```\n**Relevant information:**\n\nFor imatrix data generation, kalomaze's groups_merged.txt with added roleplay chats was used, you can find it [here](https://huggingface.co/Lewdiculous/Datura_7B-GGUF-Imatrix/blob/main/imatrix-with-rp-format-data.txt).\n\nThere's already a **v2** of this model [here](https://huggingface.co/Lewdiculous/Eris-Daturamix-7b-v2-GGUF-IQ-Imatrix).\n\n**Original model information:**\n\n![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/FtEEuyGni5M-cxkYYBBHw.jpeg)\n\n\n\nThe following models were included in the merge:\n* [ResplendentAI/Datura_7B](https://huggingface.co/ResplendentAI/Datura_7B)\n* [Test157t/Eris-Floramix-7b](https://huggingface.co/Test157t/Eris-Floramix-7b)\n\n### Configuration\n\n```yaml\nslices:\n  - sources:\n      - model: Test157t/Eris-Floramix-7b\n        layer_range: [0, 32]\n      - model: ResplendentAI/Datura_7B\n        layer_range: [0, 32]\nmerge_method: slerp\nbase_model: Test157t/Eris-Floramix-7b\nparameters:\n  t:\n    - filter: self_attn\n      value: [1, 0.5, 0.7, 0.3, 0]\n    - value: 0.5\ndtype: bfloat16\n```",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "mistral",
    "merge",
    "en",
    "dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED",
    "dataset:ResplendentAI/Synthetic_Soul_1k",
    "license:other",
    "region:us"
  ],
  "likes": 4,
  "downloads": 85,
  "gated": false,
  "private": false,
  "last_modified": "2024-03-09T01:08:18.000Z",
  "created_at": "2024-03-08T19:13:16.000Z",
  "pipeline_tag": "",
  "library_name": "transformers"
}

{
  "_id": "65eb634cd767680a0ce52bb5",
  "id": "Lewdiculous/Eris-Daturamix-7b-GGUF-IQ-Imatrix",
  "modelId": "Lewdiculous/Eris-Daturamix-7b-GGUF-IQ-Imatrix",
  "sha": "99489f8b697f139b7cc4bfeeb1b7d536e91c6d6e",
  "createdAt": "2024-03-08T19:13:16.000Z",
  "lastModified": "2024-03-09T01:08:18.000Z",
  "author": "Lewdiculous",
  "downloads": 85,
  "likes": 4,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "transformers",
  "siblings_count": 13
}