GraySoft
Projects Models About FAQ Contact Download guIDE →
Model Intelligence Sheet

neversleep/noromaid-v0.1-mixtral-8x7b-instruct-v3-gguf overview

This model is experimental, do not expect everything to work. This model uses the Alpaca prompting format(or just directly download the SillyTavern instruct preset here) --- Beeg noromaid on steroids. Suitable for RP, ERP. This time based on Mixtral Instruct, seems to do wonders! This model was trained for 8h(v1) + 8h(v2) + 12h(v3) on customized modified datasets, focusing on RP, uncensoring, and a modified version of the Alpaca prompting (that was already used in LimaRP), which should be at the same conversational level as ChatLM or Llama2-Chat without adding any additional special tokens. If you wanna have more infos about this model(and v1 + v2) you can check out my blog post Recommended settings - Settings 1 Recommended settings - Settings 2 (idk if they are any good)

gguflicense:cc-by-nc-4.0endpoints_compatibleregion:usconversational
neversleep/noromaid-v0.1-mixtral-8x7b-instruct-v3-gguf visual
Downloads
347
Likes
34
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

8 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q2_k.gguf GGUF Q2_K 14.57 GB Download
Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q3_k_m.gguf GGUF Q3_K_M 18.96 GB Download
Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q4_0.gguf GGUF 24.63 GB Download
Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q4_k_m.gguf GGUF Q4_K_M 24.63 GB Download
Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q5_0.gguf GGUF 30.02 GB Download
Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q5_k_m.gguf GGUF Q5_K_M 30.02 GB Download
Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q6_k.gguf GGUF Q6_K 35.74 GB Download
Noromaid-v0.1-mixtral-8x7b-Instruct-v3.q8_0.gguf GGUF 46.22 GB Download

Model Details Live

Model Slug
neversleep/noromaid-v0.1-mixtral-8x7b-instruct-v3-gguf
Author
NeverSleep
Pipeline Task
Library
Created
2023-12-25
Last Modified
2023-12-25
Gated
No
Private
No
HF SHA
eab2d33bc9db93b1f075d871c989bb5dffbde8a8
License
cc-by-nc-4.0
Language
Unknown
Base Model
Unknown

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "cc-by-nc-4.0",
    "frontmatter": {
      "license": "cc-by-nc-4.0"
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/vwcJfOnL-2QDJ0ShfxRJ5.png",
    "summary": "## This model is experimental, do not expect everything to work. This model uses the Alpaca **prompting format**(or just directly download the SillyTavern instruct preset here) --- Beeg noromaid on ***steroids***. Suitable for RP, ERP. This time based on Mixtral Instruct, seems to do wonders! This model was trained for 8h(v1) + 8h(v2) + 12h(v3) on customized modified datasets, focusing on RP, uncensoring, and a modified version of the Alpaca prompting (that was already used in LimaRP), which should be at the same conversational level as ChatLM or Llama2-Chat without adding any additional special tokens. If you wanna have more infos about this model(and v1 + v2) you can check out my blog post Recommended settings - Settings 1 Recommended settings - Settings 2 (idk if they are any good)",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: cc-by-nc-4.0\n---\n\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/vwcJfOnL-2QDJ0ShfxRJ5.png)\n\n\n\n---\n\n# Disclaimer:\n## This model is experimental, do not expect everything to work.\n\nThis model uses the Alpaca **prompting format**(or just directly download the SillyTavern instruct preset [here](https://files.catbox.moe/0ohmco.json))\n\n---\n\n\nBeeg noromaid on ***steroids***. Suitable for RP, ERP.\n\nThis time based on Mixtral Instruct, seems to do wonders!\n\nThis model was trained for 8h(v1) + 8h(v2) + 12h(v3) on customized modified datasets, focusing on RP, uncensoring, and a modified version of the Alpaca prompting (that was already used in LimaRP), which should be at the same conversational level as ChatLM or Llama2-Chat without adding any additional special tokens.\n\nIf you wanna have more infos about this model(and v1 + v2) you can check out [my blog post](https://ikaridevgit.github.io/index.html?p=7&blog=blogid-6&bo=true)\n\n[Recommended settings - Settings 1](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-v3/discussions/1)\n\n[Recommended settings - Settings 2 (idk if they are any good)](https://files.catbox.moe/fv4xhu.json)\n\n## Credits:\n- Undi\n- IkariDev\n\n<!-- description start -->\n## Description\n\n<!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->\n\nThis repo contains GGUF files of Noromaid-v0.1-mixtral-8x7b-Instruct-v3.\n\n[FP16 - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3)\n\n<!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)-->\n\n<!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->\n\n<!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)-->\n\n<!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->\n\n<!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)-->\n\n[GGUF - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-GGUF)\n<!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->\n\n## Ratings:\n\nNote: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!\n\nNo ratings yet!\n\nIf you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is \"ikaridev\" and \"undi\".\n\n<!-- description end -->\n<!-- prompt-template start -->\n### Custom format:\n```\n### Instruction:\n{system prompt}\n\n### Input:\n{input}\n\n### Response:\n{reply}\n```\n\n## Datasets used:\n\n- Aesir 1 and 2 ([MinervaAI](https://huggingface.co/MinervaAI) / [Gryphe](https://huggingface.co/Gryphe))\n- [LimaRP-20231109](https://huggingface.co/datasets/lemonilia/LimaRP) ([Lemonilia](https://huggingface.co/lemonilia))\n- [ToxicDPO-NoWarning](https://huggingface.co/datasets/Undi95/toxic-dpo-v0.1-sharegpt) ([unalignment orga repo](https://huggingface.co/unalignment) + [Undi](https://huggingface.co/Undi95))\n- [No-robots-ShareGPT](https://huggingface.co/datasets/Doctor-Shotgun/no-robots-sharegpt) ([Doctor-Shotgun](https://huggingface.co/Doctor-Shotgu))\n\n\n## Others\n\nUndi: If you want to support me, you can [here](https://ko-fi.com/undiai).\n\nIkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "license:cc-by-nc-4.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 34,
  "downloads": 347,
  "gated": false,
  "private": false,
  "last_modified": "2023-12-25T22:08:32.000Z",
  "created_at": "2023-12-25T18:31:09.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "6589ca6d586088fd278338c8",
  "id": "NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-GGUF",
  "modelId": "NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-GGUF",
  "sha": "eab2d33bc9db93b1f075d871c989bb5dffbde8a8",
  "createdAt": "2023-12-25T18:31:09.000Z",
  "lastModified": "2023-12-25T22:08:32.000Z",
  "author": "NeverSleep",
  "downloads": 347,
  "likes": 34,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 10
}