lewdiculous/poppy_porpoise-v0.2-l3-8b-gguf-iq-imatrix Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
lewdiculous/poppy_porpoise-v0.2-l3-8b-gguf-iq-imatrix overview
> Outdated: Outdaded tokenizer configuration! This is only kept for historical purposes, use the newer models instead of this one. For example, use version 0.72 instead. This is a Llama-3 land now, cowboys! This is an atempt at a less censored Llama-3. GGUF-IQ-Imatrix quants for Nitral-AI/Poppy_Porpoise-v0.2-L3-8B. Recommended presets here or here. Use the latest version of KoboldCpp. Use the provided presets. This is all still highly experimental, modified configs were used to avoid the tokenizer issues, let the authors know how it performs for you, feedback is more important than ever now. Original model information: !image/jpeg # "Poppy Porpoise" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences.
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Poppy_Porpoise-v0.2-L3-8B-F16.gguf | GGUF | F16 | 14.97 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-IQ3_M-imat.gguf | GGUF | IQ3_M | 3.53 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-IQ3_XXS-imat.gguf | GGUF | IQ3_XXS | 3.05 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-IQ4_NL-imat.gguf | GGUF | IQ4_NL | 4.36 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-IQ4_XS-imat.gguf | GGUF | IQ4_XS | 4.14 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-Q4_K_M-imat.gguf | GGUF | Q4_K_M | 4.58 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-Q4_K_S-imat.gguf | GGUF | Q4_K_S | 4.37 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-Q5_K_M-imat.gguf | GGUF | Q5_K_M | 5.34 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-Q5_K_S-imat.gguf | GGUF | Q5_K_S | 5.22 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-Q6_K-imat.gguf | GGUF | Q6_K | 6.14 GB | Download |
| Poppy_Porpoise-v0.2-L3-8B-Q8_0-imat.gguf | GGUF | — | 7.95 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"tags": [
"roleplay",
"llama3",
"sillytavern"
],
"frontmatter": {
"tags": [
"roleplay",
"llama3",
"sillytavern"
]
},
"hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/vaAMsVBxZ3Ix283AMQZxD.jpeg",
"summary": "> [!CAUTION] > **Outdated:** > Outdaded tokenizer configuration! > This is only kept for historical purposes, use the newer models instead of this one. > > **For example, use version 0.72 instead.** **This is a Llama-3 land now, cowboys!** This is an atempt at a less censored Llama-3. GGUF-IQ-Imatrix quants for Nitral-AI/Poppy_Porpoise-v0.2-L3-8B. > [!WARNING] > Recommended presets here or here. > Use the latest version of KoboldCpp. **Use the provided presets.** > This is all still highly experimental, modified configs were used to avoid the tokenizer issues, let the authors know how it performs for you, feedback is more important than ever now. **Original model information:** !image/jpeg # \"Poppy Porpoise\" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\ntags:\n- roleplay\n- llama3\n- sillytavern\n---\n\n> [!CAUTION]\n> **Outdated:** <br>\n> Outdaded tokenizer configuration! <br>\n> This is only kept for historical purposes, use the newer models instead of this one.\n> \n> **For example, [use version 0.72 instead.](https://huggingface.co/Lewdiculous/Poppy_Porpoise-0.72-L3-8B-GGUF-IQ-Imatrix)**\n\n**This is a Llama-3 land now, cowboys!**\n\nThis is an atempt at a less censored Llama-3.\n\nGGUF-IQ-Imatrix quants for [Nitral-AI/Poppy_Porpoise-v0.2-L3-8B](https://huggingface.co/Nitral-AI/Poppy_Porpoise-v0.2-L3-8B).\n\n> [!WARNING]\n> Recommended presets [here](https://huggingface.co/Lewdiculous/Model-Requests/tree/main/data/presets/cope-llama-3-0.1) or [here](https://huggingface.co/Virt-io/SillyTavern-Presets). <br>\n> Use the latest version of KoboldCpp. **Use the provided presets.** <br>\n> This is all still highly experimental, modified configs were used to avoid the tokenizer issues, let the authors know how it performs for you, feedback is more important than ever now.\n\n**Original model information:**\n\n\n\n# \"Poppy Porpoise\" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences.",
"related_quantizations": []
},
"tags": [
"gguf",
"roleplay",
"llama3",
"sillytavern",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 18,
"downloads": 104,
"gated": false,
"private": false,
"last_modified": "2024-06-03T05:11:06.000Z",
"created_at": "2024-04-20T13:15:49.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "6623c0056ac18a59918891dc",
"id": "Lewdiculous/Poppy_Porpoise-v0.2-L3-8B-GGUF-IQ-Imatrix",
"modelId": "Lewdiculous/Poppy_Porpoise-v0.2-L3-8B-GGUF-IQ-Imatrix",
"sha": "84ce0bf12c56de1747a78ac4ca9793448c36b0fd",
"createdAt": "2024-04-20T13:15:49.000Z",
"lastModified": "2024-06-03T05:11:06.000Z",
"author": "Lewdiculous",
"downloads": 104,
"likes": 18,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 18
}