GraySoft
Projects Models About FAQ Contact Download guIDE →
Model Intelligence Sheet

neversleep/llama-3-lumimaid-8b-v0.1-gguf overview

Comprehensive model page for neversleep/llama-3-lumimaid-8b-v0.1-gguf

ggufnot-for-all-audiencesnsfwlicense:cc-by-nc-4.0endpoints_compatibleregion:us
neversleep/llama-3-lumimaid-8b-v0.1-gguf visual
Downloads
278
Likes
34
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

4 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Llama-3-Lumimaid-8B-v0.1.q4_k_m.gguf GGUF Q4_K_M 4.58 GB Download
Llama-3-Lumimaid-8B-v0.1.q5_k_m.gguf GGUF Q5_K_M 5.34 GB Download
Llama-3-Lumimaid-8B-v0.1.q6_k.gguf GGUF Q6_K 6.14 GB Download
Llama-3-Lumimaid-8B-v0.1.q8_0.gguf GGUF 7.95 GB Download

Model Details Live

Model Slug
neversleep/llama-3-lumimaid-8b-v0.1-gguf
Author
NeverSleep
Pipeline Task
Library
Created
2024-04-30
Last Modified
2024-05-07
Gated
No
Private
No
HF SHA
a247555ee8b0a541cee793c33193e410369df17c
License
cc-by-nc-4.0
Language
Unknown
Base Model
Unknown

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "cc-by-nc-4.0",
    "tags": [
      "not-for-all-audiences",
      "nsfw"
    ],
    "frontmatter": {
      "license": "cc-by-nc-4.0",
      "tags": [
        "not-for-all-audiences",
        "nsfw"
      ]
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/d3QMaxy3peFTpSlWdWF-k.png",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: cc-by-nc-4.0\ntags:\n- not-for-all-audiences\n- nsfw\n---\n\n## Lumimaid 0.1\n\n<center><div style=\"width: 100%;\">\n    <img src=\"https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/d3QMaxy3peFTpSlWdWF-k.png\" style=\"display: block; margin: auto;\">\n</div></center>\n\nMay 1st 2024: GGUF have been fixed with [this PR of llama.cpp](https://github.com/ggerganov/llama.cpp/pull/6920)\n\nThis model uses the Llama3 **prompting format**\n\nLlama3 trained on our RP datasets, we tried to have a balance between the ERP and the RP, not too horny, but just enough.\n\nWe also added some non-RP dataset, making the model less dumb overall. It should look like a 40%/60% ratio for Non-RP/RP+ERP data.\n\nThis model includes the new Luminae dataset from Ikari.\n\n\nIf you consider trying this model please give us some feedback either on the Community tab on hf or on our [Discord Server](https://discord.gg/MtCVRWTZXY).\n\n## Credits:\n- Undi\n- IkariDev\n\n## Description\n\nThis repo contains GGUF files of Lumimaid-8B-v0.1.\n\nSwitch: [8B](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-GGUF) - [70B](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-70B-v0.1-GGUF) - [70B-alt](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-70B-v0.1-alt-GGUF) - [8B-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS-GGUF) - [70B-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-70B-v0.1-OAS-GGUF)\n\n## Training data used:\n- [Aesir datasets](https://huggingface.co/MinervaAI)\n- [NoRobots](https://huggingface.co/datasets/Doctor-Shotgun/no-robots-sharegpt)\n- [limarp](https://huggingface.co/datasets/lemonilia/LimaRP) - 8k ctx\n- [toxic-dpo-v0.1-sharegpt](https://huggingface.co/datasets/Undi95/toxic-dpo-v0.1-sharegpt)\n- [ToxicQAFinal](https://huggingface.co/datasets/NobodyExistsOnTheInternet/ToxicQAFinal)\n- Luminae-i1 (70B/70B-alt) (i2 was not existing when the 70b started training) | Luminae-i2 (8B) (this one gave better results on the 8b) - Ikari's Dataset\n- [Squish42/bluemoon-fandom-1-1-rp-cleaned](https://huggingface.co/datasets/Squish42/bluemoon-fandom-1-1-rp-cleaned) - 50% (randomly)\n- [NobodyExistsOnTheInternet/PIPPAsharegptv2test](https://huggingface.co/datasets/NobodyExistsOnTheInternet/PIPPAsharegptv2test) - 5% (randomly)\n- [cgato/SlimOrcaDedupCleaned](https://huggingface.co/datasets/cgato/SlimOrcaDedupCleaned) - 5% (randomly)\n- Airoboros (reduced)\n- [Capybara](https://huggingface.co/datasets/Undi95/Capybara-ShareGPT/) (reduced)\n\n\n## Models used (only for 8B)\n\n- Initial LumiMaid 8B Finetune\n- Undi95/Llama-3-Unholy-8B-e4\n- Undi95/Llama-3-LewdPlay-8B\n\n## Prompt template: Llama3\n\n```\n<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n{output}<|eot_id|>\n```\n\n## Others\n\nUndi: If you want to support us, you can [here](https://ko-fi.com/undiai).\n\nIkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "not-for-all-audiences",
    "nsfw",
    "license:cc-by-nc-4.0",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 34,
  "downloads": 278,
  "gated": false,
  "private": false,
  "last_modified": "2024-05-07T11:07:54.000Z",
  "created_at": "2024-04-30T00:18:41.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "663038e133ccd9e68c41cc4e",
  "id": "NeverSleep/Llama-3-Lumimaid-8B-v0.1-GGUF",
  "modelId": "NeverSleep/Llama-3-Lumimaid-8B-v0.1-GGUF",
  "sha": "a247555ee8b0a541cee793c33193e410369df17c",
  "createdAt": "2024-04-30T00:18:41.000Z",
  "lastModified": "2024-05-07T11:07:54.000Z",
  "author": "NeverSleep",
  "downloads": 278,
  "likes": 34,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 6
}