lewdiculous/mn-backyardai-party-12b-v1-gguf-iq-arm-imatrix overview

{
  "metadata": {},
  "card_data": {
    "base_model": "Sao10K/MN-BackyardAI-Party-12B-v1",
    "language": [
      "en"
    ],
    "quantized_by": "Lewdiculous",
    "library_name": "transformers",
    "license": "cc-by-nc-4.0",
    "tags": [
      "mistral",
      "arm",
      "i8mm",
      "mobile",
      "roleplay"
    ],
    "frontmatter": {
      "base_model": "Sao10K/MN-BackyardAI-Party-12B-v1",
      "language": [
        "en"
      ],
      "quantized_by": "Lewdiculous",
      "library_name": "transformers",
      "license": "cc-by-nc-4.0",
      "tags": [
        "mistral",
        "arm",
        "i8mm",
        "mobile",
        "roleplay"
      ]
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/pPih3IO0YQEN8RWZwVlIs.png",
    "summary": "My GGUF-IQ-Imatrix quants for Sao10K/MN-BackyardAI-Party-12B-v1. \"For best results, set both  and [INST] as stopping strings. Recommended Temperature is  [!NOTE] > Prompting: > * Similar to **Mistral** for group chats (please read the original model page for information on this) > * **ChatML** for one-on-one chats !image/png",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: Sao10K/MN-BackyardAI-Party-12B-v1\nlanguage:\n- en\nquantized_by: Lewdiculous\nlibrary_name: transformers\nlicense: cc-by-nc-4.0\ntags:\n- mistral\n- arm\n- i8mm\n- mobile\n- roleplay\n---\nMy GGUF-IQ-Imatrix quants for [Sao10K/MN-BackyardAI-Party-12B-v1](https://huggingface.co/Sao10K/MN-BackyardAI-Party-12B-v1).\n\n\"For best results, set both `<|im_end|>` and `[INST]` as stopping strings. Recommended Temperature is <1 , min_p of at least 0.1.\"\n\n\"This does require a lot of tinkering to fit within SillyTavern / other frontends.\"\n\n> [!NOTE]\n> Prompting:\n> * Similar to **Mistral** for group chats (please read the original model page for information on this)\n> * **ChatML** for one-on-one chats\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/pPih3IO0YQEN8RWZwVlIs.png)",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "mistral",
    "arm",
    "i8mm",
    "mobile",
    "roleplay",
    "en",
    "base_model:Sao10K/MN-BackyardAI-Party-12B-v1",
    "base_model:quantized:Sao10K/MN-BackyardAI-Party-12B-v1",
    "license:cc-by-nc-4.0",
    "endpoints_compatible",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 16,
  "downloads": 477,
  "gated": false,
  "private": false,
  "last_modified": "2024-10-03T12:34:26.000Z",
  "created_at": "2024-10-02T10:17:23.000Z",
  "pipeline_tag": "",
  "library_name": "transformers"
}

{
  "_id": "66fd1db35e36a0ed66ee770a",
  "id": "Lewdiculous/MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix",
  "modelId": "Lewdiculous/MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix",
  "sha": "0f400b49ea98fc387e83dd52273b557e351b9971",
  "createdAt": "2024-10-02T10:17:23.000Z",
  "lastModified": "2024-10-03T12:34:26.000Z",
  "author": "Lewdiculous",
  "downloads": 477,
  "likes": 16,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "transformers",
  "siblings_count": 22
}