lewdiculous/violet_twilight-v0.2-gguf-iq-imatrix overview

{
  "metadata": {},
  "card_data": {
    "base_model": "Epiculous/Violet_Twilight-v0.2",
    "license": "apache-2.0",
    "inference": false,
    "tags": [
      "mistral",
      "nemo",
      "roleplay",
      "sillytavern",
      "gguf"
    ],
    "frontmatter": {
      "base_model": "Epiculous/Violet_Twilight-v0.2",
      "license": "apache-2.0",
      "inference": "false",
      "tags": [
        "mistral",
        "nemo",
        "roleplay",
        "sillytavern",
        "gguf"
      ]
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/64adfd277b5ff762771e4571/P962FQhRG4I8nbU_DJolY.png",
    "summary": "**Model name:**  Violet_Twilight-v0.2 **Description:**  \"Now for something a bit different, Violet_Twilight-v0.2! This model is a SLERP merge of Azure_Dusk-v0.2 and Crimson_Dawn-v0.2!\"  – by Author.  Use the **ChatML** prompt format.  > [!IMPORTANT] > **[Added]**  > ARM quants:  > \"Q4_0_4_4\", \"Q4_0_4_8\", \"Q4_0_8_8\" > [!TIP] > **Presets:**  > You can use ChatML presets within SillyTavern and adjust from there.  > Alternatively, check out Virt-io's ChatML v1.9 presets here, make sure you read the repository page for how to use them properly.  > The author also provides links to custom sampler presets in the model page here. > [!NOTE] > Original model page:  > https://huggingface.co/Epiculous/Violet_Twilight-v0.2 > > Quantized using llama.cpp-b3829:  > `` > 1. Base⇢ Convert-GGUF(FP16)⇢ Generate-Imatrix-Data(FP16) > 2. Base⇢ Convert-GGUF(BF16)⇢ Use-Imatrix-Data(FP16)⇢ Quantize-GGUF(Imatrix-Quants) > `` > !waifu-model-image/png",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: Epiculous/Violet_Twilight-v0.2\nlicense: apache-2.0\ninference: false\ntags:\n- mistral\n- nemo\n- roleplay\n- sillytavern\n- gguf\n---\n\n**Model name:** <br>\nViolet_Twilight-v0.2\n\n**Description:** <br>\n\"Now for something a bit different, Violet_Twilight-v0.2! This model is a SLERP merge of Azure_Dusk-v0.2 and Crimson_Dawn-v0.2!\" <br>\n– by Author. <br>\n\nUse the **ChatML** prompt format. <br>\n\n> [!IMPORTANT]\n> **[Added]** <br>\n> ARM quants: <br>\n> `\"Q4_0_4_4\", \"Q4_0_4_8\", \"Q4_0_8_8\"`\n\n> [!TIP]\n> **Presets:** <br>\n> You can use ChatML presets within SillyTavern and adjust from there. <br>\n> Alternatively, check out [Virt-io's ChatML v1.9 presets here](https://huggingface.co/Virt-io/SillyTavern-Presets/tree/main/Prompts/ChatML/v1.9), make sure you read the [repository page for how to use them properly](https://huggingface.co/Virt-io/SillyTavern-Presets/). <br>\n> The author also provides links to custom sampler presets [in the model page here](https://huggingface.co/Epiculous/Violet_Twilight-v0.2#current-top-sampler-settings).\n\n> [!NOTE]\n> Original model page: <br>\n> https://huggingface.co/Epiculous/Violet_Twilight-v0.2\n>\n> Quantized using [llama.cpp](https://github.com/ggerganov/llama.cpp)-[b3829](https://github.com/ggerganov/llama.cpp/releases/tag/b3829): <br>\n> ```\n> 1. Base⇢ Convert-GGUF(FP16)⇢ Generate-Imatrix-Data(FP16)\n> 2. Base⇢ Convert-GGUF(BF16)⇢ Use-Imatrix-Data(FP16)⇢ Quantize-GGUF(Imatrix-Quants)\n> ```\n> \n![waifu-model-image/png](https://cdn-uploads.huggingface.co/production/uploads/64adfd277b5ff762771e4571/P962FQhRG4I8nbU_DJolY.png)",
    "related_quantizations": []
  },
  "tags": [
    "nemo",
    "gguf",
    "mistral",
    "roleplay",
    "sillytavern",
    "base_model:Epiculous/Violet_Twilight-v0.2",
    "base_model:quantized:Epiculous/Violet_Twilight-v0.2",
    "license:apache-2.0",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 18,
  "downloads": 434,
  "gated": false,
  "private": false,
  "last_modified": "2024-11-13T23:17:57.000Z",
  "created_at": "2024-09-28T12:42:37.000Z",
  "pipeline_tag": "",
  "library_name": "nemo"
}

{
  "_id": "66f7f9bda077cfd1f073700b",
  "id": "Lewdiculous/Violet_Twilight-v0.2-GGUF-IQ-Imatrix",
  "modelId": "Lewdiculous/Violet_Twilight-v0.2-GGUF-IQ-Imatrix",
  "sha": "d3b383c35f87db2560c037c555e9f1861572985d",
  "createdAt": "2024-09-28T12:42:37.000Z",
  "lastModified": "2024-11-13T23:17:57.000Z",
  "author": "Lewdiculous",
  "downloads": 434,
  "likes": 18,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "nemo",
  "siblings_count": 23
}