lewdiculous/poppy_porpoise-0.72-l3-8b-gguf-iq-imatrix Q5_K_S GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
lewdiculous/poppy_porpoise-0.72-l3-8b-gguf-iq-imatrix overview
"Poppy Porpoise" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences. !image/png # Recomended ST Presets:(Updated for 0.72) Porpoise Presets If you want to use vision functionality: You must use the latest versions of Koboldcpp. # To use the multimodal capabilities of this model and use vision you need to load the specified mmproj file, this can be found inside this model repo. Llava MMProj You can load the mmproj by using the corresponding section in the interface: !image/png
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Poppy_Porpoise-0.72-L3-8B-F16.gguf | GGUF | F16 | 14.97 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-IQ3_M-imat.gguf | GGUF | IQ3_M | 3.52 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-IQ3_S-imat.gguf | GGUF | IQ3_S | 3.43 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-IQ3_XXS-imat.gguf | GGUF | IQ3_XXS | 3.05 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-IQ4_NL-imat.gguf | GGUF | IQ4_NL | 4.36 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-IQ4_XS-imat.gguf | GGUF | IQ4_XS | 4.14 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-Q4_K_M-imat.gguf | GGUF | Q4_K_M | 4.58 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-Q4_K_S-imat.gguf | GGUF | Q4_K_S | 4.37 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-Q5_K_M-imat.gguf | GGUF | Q5_K_M | 5.34 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-Q5_K_S-imat.gguf | GGUF | Q5_K_S | 5.21 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-Q6_K-imat.gguf | GGUF | Q6_K | 6.14 GB | Download |
| Poppy_Porpoise-0.72-L3-8B-Q8_0-imat.gguf | GGUF | — | 7.95 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"tags": [
"roleplay"
],
"frontmatter": {
"tags": [
"roleplay"
]
},
"hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/_R1hvMt9_QSBRzlnzo_nY.png",
"summary": "# \"Poppy Porpoise\" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences. !image/png # Recomended ST Presets:(Updated for 0.72) Porpoise Presets If you want to use vision functionality: * You must use the latest versions of Koboldcpp. # To use the multimodal capabilities of this model and use **vision** you need to load the specified **mmproj** file, this can be found inside this model repo. Llava MMProj * You can load the **mmproj** by using the corresponding section in the interface: !image/png",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\ntags:\n- roleplay\n---\n\n> [!TIP]\n> **Support:** <br>\n> My upload speeds have been cooked and unstable lately. <br>\n> Realistically I'd need to move to get a better provider. <br>\n> If you **want** and you are able to, you can [**support that endeavor and others here (Ko-fi)**](https://ko-fi.com/Lewdiculous). I apologize for disrupting your experience.\n\n\nGGUF-IQ-Imatrix quants for [ChaoticNeutrals/Poppy_Porpoise-0.72-L3-8B](https://huggingface.co/ChaoticNeutrals/Poppy_Porpoise-0.72-L3-8B).\n\n# Original model information by the author:\n\n# \"Poppy Porpoise\" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences.\n\n\n\n# Recomended ST Presets:(Updated for 0.72) [Porpoise Presets](https://huggingface.co/ChaoticNeutrals/Poppy_Porpoise-v0.7-L3-8B/tree/main/Official%20Poppy%20Porpoise%20ST%20Presets)\n\n If you want to use vision functionality:\n\n * You must use the latest versions of [Koboldcpp](https://github.com/LostRuins/koboldcpp).\n \n # To use the multimodal capabilities of this model and use **vision** you need to load the specified **mmproj** file, this can be found inside this model repo. [Llava MMProj](https://huggingface.co/Nitral-AI/Llama-3-Update-2.0-mmproj-model-f16)\n \n * You can load the **mmproj** by using the corresponding section in the interface:\n\n ",
"related_quantizations": []
},
"tags": [
"gguf",
"roleplay",
"endpoints_compatible",
"region:us"
],
"likes": 40,
"downloads": 345,
"gated": false,
"private": false,
"last_modified": "2024-05-19T10:42:40.000Z",
"created_at": "2024-05-04T12:49:42.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "66362ee61af5b308c5410af6",
"id": "Lewdiculous/Poppy_Porpoise-0.72-L3-8B-GGUF-IQ-Imatrix",
"modelId": "Lewdiculous/Poppy_Porpoise-0.72-L3-8B-GGUF-IQ-Imatrix",
"sha": "ebe50627d0bae2c7a02d6619eb11c74ad56aad70",
"createdAt": "2024-05-04T12:49:42.000Z",
"lastModified": "2024-05-19T10:42:40.000Z",
"author": "Lewdiculous",
"downloads": 345,
"likes": 40,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 16
}