neversleep/noromaid-v0.1-mixtral-8x7b-instruct-v3-gguf overview
This model is experimental, do not expect everything to work. This model uses the Alpaca prompting format(or just directly download the SillyTavern instruct preset here) --- Beeg noromaid on steroids. Suitable for RP, ERP. This time based on Mixtral Instruct, seems to do wonders! This model was trained for 8h(v1) + 8h(v2) + 12h(v3) on customized modified datasets, focusing on RP, uncensoring, and a modified version of the Alpaca prompting (that was already used in LimaRP), which should be at the same conversational level as ChatLM or Llama2-Chat without adding any additional special tokens. If you wanna have more infos about this model(and v1 + v2) you can check out my blog post Recommended settings - Settings 1 Recommended settings - Settings 2 (idk if they are any good)
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q2_k.gguf | GGUF | Q2_K | 14.57 GB | Download |
| Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q3_k_m.gguf | GGUF | Q3_K_M | 18.96 GB | Download |
| Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q4_0.gguf | GGUF | — | 24.63 GB | Download |
| Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q4_k_m.gguf | GGUF | Q4_K_M | 24.63 GB | Download |
| Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q5_0.gguf | GGUF | — | 30.02 GB | Download |
| Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q5_k_m.gguf | GGUF | Q5_K_M | 30.02 GB | Download |
| Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q6_k.gguf | GGUF | Q6_K | 35.74 GB | Download |
| Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q8_0.gguf | GGUF | — | 46.22 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "cc-by-nc-4.0",
"frontmatter": {
"license": "cc-by-nc-4.0"
},
"hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/vwcJfOnL-2QDJ0ShfxRJ5.png",
"summary": "## This model is experimental, do not expect everything to work. This model uses the Alpaca **prompting format**(or just directly download the SillyTavern instruct preset here) --- Beeg noromaid on ***steroids***. Suitable for RP, ERP. This time based on Mixtral Instruct, seems to do wonders! This model was trained for 8h(v1) + 8h(v2) + 12h(v3) on customized modified datasets, focusing on RP, uncensoring, and a modified version of the Alpaca prompting (that was already used in LimaRP), which should be at the same conversational level as ChatLM or Llama2-Chat without adding any additional special tokens. If you wanna have more infos about this model(and v1 + v2) you can check out my blog post Recommended settings - Settings 1 Recommended settings - Settings 2 (idk if they are any good)",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: cc-by-nc-4.0\n---\n\n\n\n\n\n\n---\n\n# Disclaimer:\n## This model is experimental, do not expect everything to work.\n\nThis model uses the Alpaca **prompting format**(or just directly download the SillyTavern instruct preset [here](https://files.catbox.moe/0ohmco.json))\n\n---\n\n\nBeeg noromaid on ***steroids***. Suitable for RP, ERP.\n\nThis time based on Mixtral Instruct, seems to do wonders!\n\nThis model was trained for 8h(v1) + 8h(v2) + 12h(v3) on customized modified datasets, focusing on RP, uncensoring, and a modified version of the Alpaca prompting (that was already used in LimaRP), which should be at the same conversational level as ChatLM or Llama2-Chat without adding any additional special tokens.\n\nIf you wanna have more infos about this model(and v1 + v2) you can check out [my blog post](https://ikaridevgit.github.io/index.html?p=7&blog=blogid-6&bo=true)\n\n[Recommended settings - Settings 1](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-v3/discussions/1)\n\n[Recommended settings - Settings 2 (idk if they are any good)](https://files.catbox.moe/fv4xhu.json)\n\n## Credits:\n- Undi\n- IkariDev\n\n<!-- description start -->\n## Description\n\n<!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->\n\nThis repo contains GGUF files of Noromaid-v0.1-mixtral-8x7b-Instruct-v3.\n\n[FP16 - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3)\n\n<!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)-->\n\n<!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->\n\n<!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)-->\n\n<!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->\n\n<!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)-->\n\n[GGUF - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-GGUF)\n<!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->\n\n## Ratings:\n\nNote: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!\n\nNo ratings yet!\n\nIf you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is \"ikaridev\" and \"undi\".\n\n<!-- description end -->\n<!-- prompt-template start -->\n### Custom format:\n```\n### Instruction:\n{system prompt}\n\n### Input:\n{input}\n\n### Response:\n{reply}\n```\n\n## Datasets used:\n\n- Aesir 1 and 2 ([MinervaAI](https://huggingface.co/MinervaAI) / [Gryphe](https://huggingface.co/Gryphe))\n- [LimaRP-20231109](https://huggingface.co/datasets/lemonilia/LimaRP) ([Lemonilia](https://huggingface.co/lemonilia))\n- [ToxicDPO-NoWarning](https://huggingface.co/datasets/Undi95/toxic-dpo-v0.1-sharegpt) ([unalignment orga repo](https://huggingface.co/unalignment) + [Undi](https://huggingface.co/Undi95))\n- [No-robots-ShareGPT](https://huggingface.co/datasets/Doctor-Shotgun/no-robots-sharegpt) ([Doctor-Shotgun](https://huggingface.co/Doctor-Shotgu))\n\n\n## Others\n\nUndi: If you want to support me, you can [here](https://ko-fi.com/undiai).\n\nIkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek",
"related_quantizations": []
},
"tags": [
"gguf",
"license:cc-by-nc-4.0",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 34,
"downloads": 347,
"gated": false,
"private": false,
"last_modified": "2023-12-25T22:08:32.000Z",
"created_at": "2023-12-25T18:31:09.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "6589ca6d586088fd278338c8",
"id": "NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-GGUF",
"modelId": "NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-GGUF",
"sha": "eab2d33bc9db93b1f075d871c989bb5dffbde8a8",
"createdAt": "2023-12-25T18:31:09.000Z",
"lastModified": "2023-12-25T22:08:32.000Z",
"author": "NeverSleep",
"downloads": 347,
"likes": 34,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 10
}