lewdiculous/l3-thespice-8b-v0.1.3-gguf-iq-imatrix overview

{
  "metadata": {},
  "card_data": {
    "license": "cc-by-4.0",
    "frontmatter": {
      "license": "cc-by-4.0"
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/VNpZl0O7dpwWLK8i5RG5d.png",
    "summary": "GGUF-IQ-Imatrix quants for **cgato/L3-TheSpice-8b-v0.1.3**. > [!IMPORTANT] > These quants have been done after the fixes from llama.cpp/pull/6920.  > Use **KoboldCpp version 1.64** or higher. > [!NOTE] > **Prompt formatting...**  > Prompt format is relatively simple, author seems to recommend the **Default** context preset and **Instruct Mode - Disabled**.  > I recommend reading original **model card page information**. !image/png",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: cc-by-4.0\n---\n\n# #roleplay\n\nGGUF-IQ-Imatrix quants for **cgato/L3-TheSpice-8b-v0.1.3**.\n\n> [!IMPORTANT]  \n> These quants have been done after the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920). <br>\n> Use **KoboldCpp version 1.64** or higher.\n\n> [!NOTE]\n> **Prompt formatting...** <br>\n> Prompt format is relatively simple, author seems to recommend the **Default** context preset and **Instruct Mode - Disabled**. <br>\n> I recommend reading original [**model card page information**](https://huggingface.co/cgato/L3-TheSpice-8b-v0.1.3#prompt-format-chat--the-default-ooba-template-and-silly-tavern-template-).\n\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/VNpZl0O7dpwWLK8i5RG5d.png)\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "license:cc-by-4.0",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 12,
  "downloads": 196,
  "gated": false,
  "private": false,
  "last_modified": "2024-05-15T14:03:27.000Z",
  "created_at": "2024-04-22T14:56:43.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66267aab2fe0949065f2ea01",
  "id": "Lewdiculous/L3-TheSpice-8b-v0.1.3-GGUF-IQ-Imatrix",
  "modelId": "Lewdiculous/L3-TheSpice-8b-v0.1.3-GGUF-IQ-Imatrix",
  "sha": "39ca461a7a95f8c34b721d13e68239ed5f2cfac0",
  "createdAt": "2024-04-22T14:56:43.000Z",
  "lastModified": "2024-05-15T14:03:27.000Z",
  "author": "Lewdiculous",
  "downloads": 196,
  "likes": 12,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 15
}