lewdiculous/mn-12b-lyra-v4-gguf-iq-imatrix overview

{
  "metadata": {},
  "card_data": {
    "base_model": "Sao10K/MN-12B-Lyra-v4",
    "license": "cc-by-nc-4.0",
    "inference": false,
    "tags": [
      "mistral",
      "nemo",
      "roleplay",
      "sillytavern"
    ],
    "frontmatter": {
      "base_model": "Sao10K/MN-12B-Lyra-v4",
      "license": "cc-by-nc-4.0",
      "inference": "false",
      "tags": [
        "mistral",
        "nemo",
        "roleplay",
        "sillytavern"
      ]
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/dVoru83WOpwVjMlgZ_xhA.png",
    "summary": "**Model name:**  MN-12B-Lyra-v4 **Brief description:**  A finetune of Mistral Nemo by Sao10K.  Uses the ChatML prompt format.  > [!TIP] > **Presets:**  > You can use the built in ChatML presets within SillyTavern and adjust from there.  > Alternatively, check out Virt-io's ChatML v1.9 presets here, make sure you read the repository page for how to use them properly. > [!NOTE] > Request page:  > https://huggingface.co/Lewdiculous/Model-Requests/discussions/75 > > Model link:  > https://huggingface.co/Sao10K/MN-12B-Lyra-v4 > > Quantized with llama.cpp:  > b3707 !image/png",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: Sao10K/MN-12B-Lyra-v4\nlicense: cc-by-nc-4.0\ninference: false\ntags:\n- mistral\n- nemo\n- roleplay\n- sillytavern\n---\n\n**Model name:** <br>\nMN-12B-Lyra-v4\n\n**Brief description:** <br>\nA finetune of Mistral Nemo by [Sao10K](https://huggingface.co/Sao10K/). <br>\nUses the ChatML prompt format. <br>\n\n> [!TIP]\n> **Presets:** <br>\n> You can use the built in ChatML presets within SillyTavern and adjust from there. <br>\n> Alternatively, check out [Virt-io's ChatML v1.9 presets here](https://huggingface.co/Virt-io/SillyTavern-Presets/tree/main/Prompts/ChatML/v1.9), make sure you read the [repository page for how to use them properly](https://huggingface.co/Virt-io/SillyTavern-Presets/).\n\n> [!NOTE]\n> Request page: <br>\n> https://huggingface.co/Lewdiculous/Model-Requests/discussions/75\n>\n> Model link: <br>\n> https://huggingface.co/Sao10K/MN-12B-Lyra-v4\n>\n> Quantized with llama.cpp: <br>\n> [b3707](https://github.com/ggerganov/llama.cpp/releases/tag/b3707)\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/dVoru83WOpwVjMlgZ_xhA.png)\n\n",
    "related_quantizations": []
  },
  "tags": [
    "nemo",
    "gguf",
    "mistral",
    "roleplay",
    "sillytavern",
    "base_model:Sao10K/MN-12B-Lyra-v4",
    "base_model:quantized:Sao10K/MN-12B-Lyra-v4",
    "license:cc-by-nc-4.0",
    "region:us",
    "conversational"
  ],
  "likes": 40,
  "downloads": 7227,
  "gated": false,
  "private": false,
  "last_modified": "2024-09-10T08:02:23.000Z",
  "created_at": "2024-09-09T14:13:25.000Z",
  "pipeline_tag": "",
  "library_name": "nemo"
}

{
  "_id": "66df0285d05219e329c178bc",
  "id": "Lewdiculous/MN-12B-Lyra-v4-GGUF-IQ-Imatrix",
  "modelId": "Lewdiculous/MN-12B-Lyra-v4-GGUF-IQ-Imatrix",
  "sha": "dad0c53ae8b48bd131e919d6740bb4db365a8cc7",
  "createdAt": "2024-09-09T14:13:25.000Z",
  "lastModified": "2024-09-10T08:02:23.000Z",
  "author": "Lewdiculous",
  "downloads": 7227,
  "likes": 40,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "nemo",
  "siblings_count": 22
}