lewdiculous/mn-12b-mag-mell-r1-gguf-iq-arm-imatrix overview

{
  "metadata": {},
  "card_data": {
    "license": "unlicense",
    "language": [
      "en"
    ],
    "base_model": [
      "inflatebot/MN-12B-Mag-Mell-R1"
    ],
    "tags": [
      "roleplay",
      "rp",
      "sillytavern",
      "gguf",
      "mistral",
      "nemo"
    ],
    "inference": false,
    "frontmatter": {
      "license": "unlicense",
      "language": [
        "en"
      ],
      "base_model": [
        "inflatebot/MN-12B-Mag-Mell-R1"
      ],
      "tags": [
        "roleplay",
        "rp",
        "sillytavern",
        "gguf",
        "mistral",
        "nemo"
      ],
      "inference": "false"
    },
    "hero_image_url": "https://i.imgur.com/wjyAaTO.png",
    "summary": "My GGUF-IQ-ARM-Imatrix quants for **inflatebot/MN-12B-Mag-Mell-R1**. > Mag Mell R1 was tested with Temp 1.25 and MinP 0.2. This was fairly stable up to 10K, but this might be too \"hot\". If issues with coherency occur, try increasing MinP or decreasing Temperature. > [!NOTE] > Use the **ChatML** prompt format. !model-card-image",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: unlicense\nlanguage:\n- en\nbase_model:\n- inflatebot/MN-12B-Mag-Mell-R1\ntags:\n- roleplay\n- rp\n- sillytavern\n- gguf\n- mistral\n- nemo\ninference: false\n---\n\nMy GGUF-IQ-ARM-Imatrix quants for [**inflatebot/MN-12B-Mag-Mell-R1**](https://huggingface.co/inflatebot/MN-12B-Mag-Mell-R1).\n\n> Mag Mell R1 was tested with Temp 1.25 and MinP 0.2. This was fairly stable up to 10K, but this might be too \"hot\". If issues with coherency occur, try increasing MinP or decreasing Temperature.\n\n> [!NOTE]\n> Use the **ChatML** prompt format.\n\n![model-card-image](https://i.imgur.com/wjyAaTO.png)\n",
    "related_quantizations": []
  },
  "tags": [
    "nemo",
    "gguf",
    "roleplay",
    "rp",
    "sillytavern",
    "mistral",
    "en",
    "base_model:inflatebot/MN-12B-Mag-Mell-R1",
    "base_model:quantized:inflatebot/MN-12B-Mag-Mell-R1",
    "license:unlicense",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 13,
  "downloads": 789,
  "gated": false,
  "private": false,
  "last_modified": "2024-12-06T02:45:10.000Z",
  "created_at": "2024-12-06T01:28:23.000Z",
  "pipeline_tag": "",
  "library_name": "nemo"
}

{
  "_id": "67525337d34997a5fbad2a8c",
  "id": "Lewdiculous/MN-12B-Mag-Mell-R1-GGUF-IQ-ARM-Imatrix",
  "modelId": "Lewdiculous/MN-12B-Mag-Mell-R1-GGUF-IQ-ARM-Imatrix",
  "sha": "cd1175c9195ad85f5438f56be721f535dfbe5658",
  "createdAt": "2024-12-06T01:28:23.000Z",
  "lastModified": "2024-12-06T02:45:10.000Z",
  "author": "Lewdiculous",
  "downloads": 789,
  "likes": 13,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "nemo",
  "siblings_count": 20
}