duyntnet/silicon-maid-7b-imatrix-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "other",
    "language": [
      "en"
    ],
    "pipeline_tag": "text-generation",
    "inference": false,
    "tags": [
      "transformers",
      "gguf",
      "imatrix",
      "Silicon-Maid-7B"
    ],
    "frontmatter": {
      "license": "other",
      "language": [
        "en"
      ],
      "pipeline_tag": "text-generation",
      "inference": "false",
      "tags": [
        "transformers",
        "gguf",
        "imatrix",
        "Silicon-Maid-7B"
      ]
    },
    "hero_image_url": "",
    "summary": "Silicon-Maid-7B is another model targeted at being both strong at RP **and** being a smart cookie that can follow character cards very well. As of right now, Silicon-Maid-7B outscores both of my previous 7B RP models in my RP benchmark and I have been impressed by this model's creativity. It is suitable for RP/ERP and general use. ### Prompt Template (Alpaca) I found the best SillyTavern results from using the Noromaid template but please try other templates! Let me know if you find anything good. SillyTavern config files: Context, Instruct. Additionally, here is my highly recommended Text Completion preset. You can tweak this by adjusting temperature up or dropping min p to boost creativity or raise min p to increase stability. You shouldn't need to touch anything else! `` Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {prompt} ### Response: ``",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: other\nlanguage:\n- en\npipeline_tag: text-generation\ninference: false\ntags:\n- transformers\n- gguf\n- imatrix\n- Silicon-Maid-7B\n---\nQuantizations of https://huggingface.co/SanjiWatsuki/Silicon-Maid-7B\n\n### Experiment\n\nQuants **ending in \"_X\"** are experimental quants. These quants are the same as normal quants, but their token embedding weights are set to Q8_0 except for Q6_K and Q8_0 which are set to F16. The change will make these experimental quants larger but in theory, should result in improved performance.\n\nList of experimental quants: \n* Q2_K_X\n* Q4_K_M_X\n* Q5_K_M_X\n* Q6_K_X\n* Q8_0_X\n\n---\n\n### Inference Clients/UIs\n* [llama.cpp](https://github.com/ggerganov/llama.cpp)\n* [JanAI](https://github.com/janhq/jan)\n* [KoboldCPP](https://github.com/LostRuins/koboldcpp)\n* [text-generation-webui](https://github.com/oobabooga/text-generation-webui)\n* [ollama](https://github.com/ollama/ollama)\n\n---\n\n# From original readme\n\nSilicon-Maid-7B is another model targeted at being both strong at RP **and** being a smart cookie that can follow character cards very well. As of right now, Silicon-Maid-7B outscores both of my previous 7B RP models in my RP benchmark and I have been impressed by this model's creativity. It is suitable for RP/ERP and general use.\n\n### Prompt Template (Alpaca)\nI found the best SillyTavern results from using the Noromaid template but please try other templates! Let me know if you find anything good.\n\nSillyTavern config files: [Context](https://files.catbox.moe/ifmhai.json), [Instruct](https://files.catbox.moe/ttw1l9.json).\n\nAdditionally, here is my highly recommended [Text Completion preset](https://huggingface.co/SanjiWatsuki/Loyal-Macaroni-Maid-7B/blob/main/Characters/MinP.json). You can tweak this by adjusting temperature up or dropping min p to boost creativity or raise min p to increase stability. You shouldn't need to touch anything else!\n\n```\nBelow is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{prompt}\n\n### Response:\n```",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "imatrix",
    "Silicon-Maid-7B",
    "text-generation",
    "en",
    "license:other",
    "region:us"
  ],
  "likes": 6,
  "downloads": 247,
  "gated": false,
  "private": false,
  "last_modified": "2024-07-02T13:51:42.000Z",
  "created_at": "2024-07-02T10:27:14.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}

{
  "_id": "6683d6023d01a30be93b2cef",
  "id": "duyntnet/Silicon-Maid-7B-imatrix-GGUF",
  "modelId": "duyntnet/Silicon-Maid-7B-imatrix-GGUF",
  "sha": "51cf8c813501ce71cc83ec0e892628a97617776c",
  "createdAt": "2024-07-02T10:27:14.000Z",
  "lastModified": "2024-07-02T13:51:42.000Z",
  "author": "duyntnet",
  "downloads": 247,
  "likes": 6,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 34
}