lewdiculous/eris_floramix_dpo_7b-gguf-imatrix overview

{
  "metadata": {},
  "card_data": {
    "library_name": "transformers",
    "license": "other",
    "datasets": [
      "athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED",
      "ResplendentAI/Synthetic_Soul_1k"
    ],
    "language": [
      "en"
    ],
    "tags": [
      "gguf",
      "quantized",
      "roleplay",
      "imatrix",
      "mistral"
    ],
    "inference": false,
    "frontmatter": {
      "library_name": "transformers",
      "license": "other",
      "datasets": [
        "athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED",
        "ResplendentAI/Synthetic_Soul_1k"
      ],
      "language": [
        "en"
      ],
      "tags": [
        "gguf",
        "quantized",
        "roleplay",
        "imatrix",
        "mistral"
      ],
      "inference": "false"
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/1kuWjS4TnCIkCcdZdPfsG.png",
    "summary": "This is a mix between Eris Remix DPO and Flora DPO, a finetune of the original Eris Remix on the Synthetic_Soul_1k dataset. Applied this DPO dataset: https://huggingface.co/datasets/athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlibrary_name: transformers\nlicense: other\ndatasets:\n- athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED\n- ResplendentAI/Synthetic_Soul_1k\nlanguage:\n- en\ntags:\n- gguf\n- quantized\n- roleplay\n- imatrix\n- mistral\n\ninference: false\n---\n\nThis repository hosts GGUF-Imatrix quantizations for [ChaoticNeutrals/Eris_Floramix_DPO_7B](https://huggingface.co/ChaoticNeutrals/Eris_Floramix_DPO_7B).\n\n```\nBase⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)\n```\n\n```python\n    quantization_options = [\n        \"Q3_K_M\", \"Q4_K_M\", \"Q5_K_M\", \"Q6_K\",\n        \"Q8_0\", \"IQ4_XS\", \"IQ3_XXS\"\n    ]\n```\n**This is experimental.**\n\nFor imatrix data generation, kalomaze's `groups_merged.txt` with added roleplay chats was used, you can find it [here](https://huggingface.co/Lewdiculous/Datura_7B-GGUF-Imatrix/blob/main/imatrix-with-rp-format-data.txt).\n\nThe goal is to measure the (hopefully positive) impact of this data for consistent formatting in roleplay chatting scenarios.\n\n**Image:**\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/1kuWjS4TnCIkCcdZdPfsG.png)\n\n**Original model information:**\n\n# Eris Floramix DPO\n\nThis is a mix between Eris Remix DPO and Flora DPO, a finetune of the original Eris Remix on the Synthetic_Soul_1k dataset.\n\nApplied this DPO dataset: https://huggingface.co/datasets/athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "quantized",
    "roleplay",
    "imatrix",
    "mistral",
    "en",
    "dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED",
    "dataset:ResplendentAI/Synthetic_Soul_1k",
    "license:other",
    "region:us"
  ],
  "likes": 4,
  "downloads": 145,
  "gated": false,
  "private": false,
  "last_modified": "2024-03-08T19:54:24.000Z",
  "created_at": "2024-03-08T05:43:47.000Z",
  "pipeline_tag": "",
  "library_name": "transformers"
}

{
  "_id": "65eaa593b11eeb516a982844",
  "id": "Lewdiculous/Eris_Floramix_DPO_7B-GGUF-Imatrix",
  "modelId": "Lewdiculous/Eris_Floramix_DPO_7B-GGUF-Imatrix",
  "sha": "4c54bc83c72de5181e7b8da33b6717002e47e2fd",
  "createdAt": "2024-03-08T05:43:47.000Z",
  "lastModified": "2024-03-08T19:54:24.000Z",
  "author": "Lewdiculous",
  "downloads": 145,
  "likes": 4,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "transformers",
  "siblings_count": 12
}