davidau/nsfw_dpo_noromaid-7b-mistral-7b-instruct-v0.1-q6_k-gguf Q6_K GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
davidau/nsfw_dpo_noromaid-7b-mistral-7b-instruct-v0.1-q6_k-gguf overview
This model was converted to GGUF format from MaziyarPanahi/NSFWDPONoromaid-7b-Mistral-7B-Instruct-v0.1 using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.
Downloads
118
Likes
7
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
1 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| nsfw_dpo_noromaid-7b-mistral-7b-instruct-v0.1.Q6_K.gguf | GGUF | Q6_K | 5.53 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"tags": [
"Safetensors",
"mistral",
"text-generation-inference",
"merge",
"7b",
"mistralai/Mistral-7B-Instruct-v0.1",
"athirdpath/NSFW_DPO_Noromaid-7b",
"transformers",
"safetensors",
"text-generation",
"en",
"dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v2",
"dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW",
"license:cc-by-nc-4.0",
"autotrain_compatible",
"endpoints_compatible",
"has_space",
"region:us",
"llama-cpp",
"gguf-my-repo"
],
"frontmatter": {
"license": "apache-2.0",
"tags": [
"Safetensors",
"mistral",
"text-generation-inference",
"merge",
"7b",
"mistralai/Mistral-7B-Instruct-v0.1",
"athirdpath/NSFW_DPO_Noromaid-7b",
"transformers",
"safetensors",
"text-generation",
"en",
"dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v2",
"dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW",
"license:cc-by-nc-4.0",
"autotrain_compatible",
"endpoints_compatible",
"has_space",
"region:us",
"llama-cpp",
"gguf-my-repo"
]
},
"hero_image_url": "",
"summary": "This model was converted to GGUF format from MaziyarPanahi/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1 using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\ntags:\n- Safetensors\n- mistral\n- text-generation-inference\n- merge\n- 7b\n- mistralai/Mistral-7B-Instruct-v0.1\n- athirdpath/NSFW_DPO_Noromaid-7b\n- transformers\n- safetensors\n- text-generation\n- en\n- dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v2\n- dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW\n- license:cc-by-nc-4.0\n- autotrain_compatible\n- endpoints_compatible\n- has_space\n- region:us\n- llama-cpp\n- gguf-my-repo\n---\n\n# DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF\nThis model was converted to GGUF format from [`MaziyarPanahi/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1`](https://huggingface.co/MaziyarPanahi/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.\nRefer to the [original model card](https://huggingface.co/MaziyarPanahi/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1) for more details on the model.\n## Use with llama.cpp\n\nInstall llama.cpp through brew.\n\n```bash\nbrew install ggerganov/ggerganov/llama.cpp\n```\nInvoke the llama.cpp server or the CLI.\n\nCLI:\n\n```bash\nllama-cli --hf-repo DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF --model nsfw_dpo_noromaid-7b-mistral-7b-instruct-v0.1.Q6_K.gguf -p \"The meaning to life and the universe is\"\n```\n\nServer:\n\n```bash\nllama-server --hf-repo DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF --model nsfw_dpo_noromaid-7b-mistral-7b-instruct-v0.1.Q6_K.gguf -c 2048\n```\n\nNote: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.\n\n```\ngit clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make && ./main -m nsfw_dpo_noromaid-7b-mistral-7b-instruct-v0.1.Q6_K.gguf -n 128\n```\n",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"Safetensors",
"mistral",
"text-generation-inference",
"merge",
"7b",
"mistralai/Mistral-7B-Instruct-v0.1",
"athirdpath/NSFW_DPO_Noromaid-7b",
"safetensors",
"text-generation",
"en",
"dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v2",
"dataset:athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW",
"license:cc-by-nc-4.0",
"autotrain_compatible",
"endpoints_compatible",
"has_space",
"region:us",
"llama-cpp",
"gguf-my-repo",
"license:apache-2.0",
"conversational"
],
"likes": 7,
"downloads": 118,
"gated": false,
"private": false,
"last_modified": "2024-04-21T10:43:15.000Z",
"created_at": "2024-04-21T10:43:00.000Z",
"pipeline_tag": "text-generation",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "6624edb44fc5602afbbec923",
"id": "DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF",
"modelId": "DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF",
"sha": "d8bb4b444d9a7a94a83ba6e608899282d67a3850",
"createdAt": "2024-04-21T10:43:00.000Z",
"lastModified": "2024-04-21T10:43:15.000Z",
"author": "DavidAU",
"downloads": 118,
"likes": 7,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "transformers",
"siblings_count": 3
}