lewdiculous/chaos_rp_l3_8b-gguf-iq-imatrix overview

{
  "metadata": {},
  "card_data": {
    "tags": [
      "roleplay",
      "llama3",
      "sillytavern",
      "gguf"
    ],
    "license": "apache-2.0",
    "frontmatter": {
      "tags": [
        "roleplay",
        "llama3",
        "sillytavern",
        "gguf"
      ],
      "license": "apache-2.0"
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/626dfb8786671a29c715f8a9/u5p9kdbXT2QQA3iMU0vF1.png",
    "summary": "!image/png A chaotic force beckons for you, will you heed her call? Built upon an intelligent foundation and tuned for roleplaying, this model will fulfill your wildest fantasies with the bare minimum of effort. Enjoy!",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\ntags:\n- roleplay\n- llama3\n- sillytavern\n- gguf\nlicense: apache-2.0\n---\n\n> [!TIP]\n> **Support:** <br>\n> My upload speeds have been cooked and unstable lately. <br>\n> Realistically I'd need to move to get a better provider. <br>\n> If you **want** and you are able to... <br>\n> [**You can support my various endeavors here (Ko-fi).**](https://ko-fi.com/Lewdiculous) <br>\n> I apologize for disrupting your experience.\n\n\n**This is a Llama-3 land now, cowboys!**\n\n\"A chaotic force beckons for you, will you heed her call?\"\n\nGGUF-IQ-Imatrix quants for [jeiku/Chaos_RP_l3_8B](https://huggingface.co/jeiku/Chaos_RP_l3_8B).\n\n> [!IMPORTANT]  \n> **Updated!**\n> These quants have been redone with the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920) in mind. <br>\n> Use **KoboldCpp version 1.64** or higher.\n\n> [!NOTE]\n> **Quant:** <br>\n> For **8GB VRAM** GPUs, I recommend the **Q4_K_M-imat** quant for up to 12288 context sizes.\n\n> [!WARNING]\n> Recommended presets [here](https://huggingface.co/Lewdiculous/Model-Requests/tree/main/data/presets/cope-llama-3-0.1) or [here](https://huggingface.co/Virt-io/SillyTavern-Presets). <br>\n> Use the latest version of KoboldCpp. **Use the provided presets.** <br>\n> This is all still highly experimental, modified configs were used to avoid the tokenizer issues, let the authors know how it performs for you, feedback is more important than ever now.\n\n**Original model information:**\n\n# Chaos RP\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/626dfb8786671a29c715f8a9/u5p9kdbXT2QQA3iMU0vF1.png)\n\nA chaotic force beckons for you, will you heed her call?\n\nBuilt upon an intelligent foundation and tuned for roleplaying, this model will fulfill your wildest fantasies with the bare minimum of effort.\n\nEnjoy!",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "roleplay",
    "llama3",
    "sillytavern",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 21,
  "downloads": 166,
  "gated": false,
  "private": false,
  "last_modified": "2024-05-04T14:39:16.000Z",
  "created_at": "2024-04-22T19:00:39.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "6626b3d74daa347d51ec83fb",
  "id": "Lewdiculous/Chaos_RP_l3_8B-GGUF-IQ-Imatrix",
  "modelId": "Lewdiculous/Chaos_RP_l3_8B-GGUF-IQ-Imatrix",
  "sha": "a2496ad3ade416e46ad228504ba7707a49ec918d",
  "createdAt": "2024-04-22T19:00:39.000Z",
  "lastModified": "2024-05-04T14:39:16.000Z",
  "author": "Lewdiculous",
  "downloads": 166,
  "likes": 21,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 15
}