davidau/mpt-7b-wizardlm_uncensored-storywriter-merge-q6_k-gguf overview

{
  "metadata": {},
  "card_data": {
    "tags": [
      "llama-cpp",
      "gguf-my-repo"
    ],
    "frontmatter": {
      "tags": [
        "llama-cpp",
        "gguf-my-repo"
      ]
    },
    "hero_image_url": "",
    "summary": "This model was converted to GGUF format from TehVenom/MPT-7b-WizardLM_Uncensored-Storywriter-Merge using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\ntags:\n- llama-cpp\n- gguf-my-repo\n---\n\n# DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF\nThis model was converted to GGUF format from [`TehVenom/MPT-7b-WizardLM_Uncensored-Storywriter-Merge`](https://huggingface.co/TehVenom/MPT-7b-WizardLM_Uncensored-Storywriter-Merge) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.\nRefer to the [original model card](https://huggingface.co/TehVenom/MPT-7b-WizardLM_Uncensored-Storywriter-Merge) for more details on the model.\n## Use with llama.cpp\n\nInstall llama.cpp through brew.\n\n<B>Versions of GRAND HORROR - that can be used for all storytelling / for all genres (in release order):</B>\n\nNote that model output varies between versions - if you find one version does not meet your requirements, try a different\nversion at same quant(s) level.\n\nDifferences can include use of adjectives (or not), \"gory level\", \"horror level\", intensity, paragraph and sentence structure etc etc.\n\n<small>\n\n[ https://huggingface.co/DavidAU/L3-Grand-HORROR-25B-V2-STABLE-Godzillas-Wicked-Sister-GGUF ]\n\n[ https://huggingface.co/DavidAU/L3-Grand-HORROR-20.7B-V1.9-STABLE-Hathors-Revenge-GGUF ] \n\n[ https://huggingface.co/DavidAU/L3-Grand-HORROR-18.5B-V1.8-STABLE-10-Gates-of-Hell-GGUF ] \n\n[ https://huggingface.co/DavidAU/L3-Grand-HORROR-17.4B-V1.7-STABLE-Kiss-Of-Death-GGUF ]\n\n[ https://huggingface.co/DavidAU/L3-Stheno-Maid-Blackroot-Grand-HORROR-16.5B-V1.6-STABLE-INTENSE-GGUF ]\n\n[ https://huggingface.co/DavidAU/L3-Stheno-Maid-Blackroot-Grand-HORROR-16.5B-V1.5-STABLE-GGUF ]\n\n[ https://huggingface.co/DavidAU/Llama3-Little-LLM-Of-Horror_N_Fiction-14.6B-GGUF ]\n\n[ https://huggingface.co/DavidAU/L3-Stheno-Maid-Blackroot-Grand-HORROR-16B-Ultra-NEO-V2-IMATRIX-GGUF ]\n\n[ https://huggingface.co/DavidAU/L3-Stheno-Maid-Blackroot-Grand-HORROR-16B-GGUF ] \n\n</small>\n\n```bash\nbrew install ggerganov/ggerganov/llama.cpp\n```\nInvoke the llama.cpp server or the CLI.\n\nCLI:\n\n```bash\nllama-cli --hf-repo DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF --model mpt-7b-wizardlm_uncensored-storywriter-merge.Q6_K.gguf -p \"The meaning to life and the universe is\"\n```\n\nServer:\n\n```bash\nllama-server --hf-repo DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF --model mpt-7b-wizardlm_uncensored-storywriter-merge.Q6_K.gguf -c 2048\n```\n\nNote: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.\n\n```\ngit clone https://github.com/ggerganov/llama.cpp &&             cd llama.cpp &&             make &&             ./main -m mpt-7b-wizardlm_uncensored-storywriter-merge.Q6_K.gguf -n 128\n```\n\n---\n\n<h2>Special Thanks:</h2>\n\n---\n\nSpecial thanks to all the following, and many more...\n\nAll the model makers, fine tuners, mergers, and tweakers:\n- Provides the raw \"DNA\" for almost all my models.\n- Sources of model(s) can be found on the repo pages, especially the \"source\" repos with link(s) to the model creator(s).\n\nHuggingface [ https://huggingface.co ] :\n- The place to store, merge, and tune models endlessly.\n- THE reason we have an open source community.\n\nLlamaCPP [ https://github.com/ggml-org/llama.cpp ] :\n- The ability to compress and run models on GPU(s), CPU(s) and almost all devices.\n- Imatrix, Quantization, and other tools to tune the quants and the models.\n- Llama-Server : A cli based direct interface to run GGUF models.\n- The only tool I use to quant models.\n\nQuant-Masters: Team Mradermacher, Bartowski, and many others:\n- Quant models day and night for us all to use.\n- They are the lifeblood of open source access.\n\nMergeKit [ https://github.com/arcee-ai/mergekit ] :\n- The universal online/offline tool to merge models together and forge something new.\n- Over 20 methods to almost instantly merge model, pull them apart and put them together again.\n- The tool I have used to create over 1500 models.\n\nLmstudio [ https://lmstudio.ai/ ] :\n- The go to tool to test and run models in GGUF format.\n- The Tool I use to test/refine and evaluate new models.\n- LMStudio forum on discord; endless info and community for open source.\n\nText Generation Webui // KolboldCPP // SillyTavern:\n- Excellent tools to run GGUF models with - [  https://github.com/oobabooga/text-generation-webui ] [ https://github.com/LostRuins/koboldcpp ] .\n- Sillytavern [ https://github.com/SillyTavern/SillyTavern ] can be used with LMSTudio [ https://lmstudio.ai/ ] , TextGen [ https://github.com/oobabooga/text-generation-webui ], Kolboldcpp [ https://github.com/LostRuins/koboldcpp ], Llama-Server [part of LLAMAcpp] as a off the scale front end control system and interface to work with models.\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "llama-cpp",
    "gguf-my-repo",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 26,
  "downloads": 300,
  "gated": false,
  "private": false,
  "last_modified": "2025-07-28T00:20:31.000Z",
  "created_at": "2024-04-11T03:32:52.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "661759e451222b41dce7e81f",
  "id": "DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF",
  "modelId": "DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF",
  "sha": "3d269b8528b46b93216ecbb446da7caebf307b95",
  "createdAt": "2024-04-11T03:32:52.000Z",
  "lastModified": "2025-07-28T00:20:31.000Z",
  "author": "DavidAU",
  "downloads": 300,
  "likes": 26,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 3
}