GraySoft
Projects Models About FAQ Contact Download guIDE →

llmfan46/ms3.2-paintedfantasy-visage-v3-34b-ultra-uncensored-heretic-gguf BF16 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

llmfan46/ms3.2-paintedfantasy-visage-v3-34b-ultra-uncensored-heretic-gguf overview

Comprehensive model page for llmfan46/ms3.2-paintedfantasy-visage-v3-34b-ultra-uncensored-heretic-gguf

ggufhereticuncensoreddecensoredabliteratedaradataset:zerofata/Instruct-Animedataset:zerofata/Instruct-Anime-CreativeWritingdataset:zerofata/Roleplay-Anime-Charactersdataset:zerofata/Summaries-Anime-FandomPagesbase_model:llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-hereticbase_model:quantized:llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-hereticendpoints_compatibleregion:usconversational
llmfan46/ms3.2-paintedfantasy-visage-v3-34b-ultra-uncensored-heretic-gguf visual
Downloads
517
Likes
0
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

6 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-BF16.gguf GGUF BF16 63.58 GB Download
MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q4_K_M.gguf GGUF Q4_K_M 19.27 GB Download
MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q5_K_M.gguf GGUF Q5_K_M 22.59 GB Download
MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q5_K_S.gguf GGUF Q5_K_S 21.95 GB Download
MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q6_K.gguf GGUF Q6_K 26.08 GB Download
MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q8_0.gguf GGUF 33.78 GB Download

Model Details Live

Model Slug
llmfan46/ms3.2-paintedfantasy-visage-v3-34b-ultra-uncensored-heretic-gguf
Author
llmfan46
Pipeline Task
Library
Created
2026-03-27
Last Modified
2026-03-27
Gated
No
Private
No
HF SHA
0aa30b1d0fe3693aaa652444a014b38be3dad36c
License
Unknown
Language
Unknown
Base Model
llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "datasets": [
      "zerofata/Instruct-Anime",
      "zerofata/Instruct-Anime-CreativeWriting",
      "zerofata/Roleplay-Anime-Characters",
      "zerofata/Summaries-Anime-FandomPages"
    ],
    "base_model": [
      "llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic"
    ],
    "tags": [
      "heretic",
      "uncensored",
      "decensored",
      "abliterated",
      "ara"
    ],
    "frontmatter": {
      "datasets": [
        "zerofata/Instruct-Anime",
        "zerofata/Instruct-Anime-CreativeWriting",
        "zerofata/Roleplay-Anime-Characters",
        "zerofata/Summaries-Anime-FandomPages"
      ],
      "base_model": [
        "llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic"
      ],
      "tags": [
        "heretic",
        "uncensored",
        "decensored",
        "abliterated",
        "ara"
      ]
    },
    "hero_image_url": "https://huggingface.co/llmfan46/Omega-Darker-Gaslight_The-Final-Forgotten-Fever-Dream-24B-ultra-uncensored-heretic-v1/resolve/main/waifu001.webp",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\ndatasets:\n- zerofata/Instruct-Anime\n- zerofata/Instruct-Anime-CreativeWriting\n- zerofata/Roleplay-Anime-Characters\n- zerofata/Summaries-Anime-FandomPages\nbase_model:\n- llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic\ntags:\n- heretic\n- uncensored\n- decensored\n- abliterated\n- ara\n---\n<div style=\"background-color: #ff4444; color: white; padding: 20px; border-radius: 10px; text-align: center; margin: 20px 0;\">\n<h2 style=\"color: white; margin: 0 0 10px 0;\">🚨⚠️ I HAVE REACHED HUGGING FACE'S FREE STORAGE LIMIT ⚠️🚨</h2>\n<p style=\"font-size: 18px; margin: 0 0 15px 0;\">I can no longer upload new models unless I can cover the cost of additional storage.<br>I host <b>70+ free models</b> as an independent contributor and this work is unpaid.<br><b>Without your support, no more new models can be uploaded.</b></p>\n<p style=\"font-size: 20px; margin: 0;\">\n<a href=\"https://patreon.com/LLMfan46\" style=\"color: white; text-decoration: underline;\">🎉 Patreon (Monthly)</a> &nbsp;|&nbsp;\n<a href=\"https://ko-fi.com/llmfan46\" style=\"color: white; text-decoration: underline;\">☕ Ko-fi (One-time)</a>\n</p>\n<p style=\"font-size: 16px; margin: 10px 0 0 0;\">Every contribution goes directly toward Hugging Face storage fees to keep models free for everyone.</p>\n</div>\n\n---\n\n### **97% fewer refusals** (4/100 Uncensored vs 90/100 Original) while preserving model quality (0.0195 KL divergence).\n\n## ❤️ Support My Work\nCreating these models takes significant time, work and compute. If you find them useful consider supporting me:\n\n![image/png](https://huggingface.co/llmfan46/Omega-Darker-Gaslight_The-Final-Forgotten-Fever-Dream-24B-ultra-uncensored-heretic-v1/resolve/main/waifu001.webp)\n\n| Platform | Link | What you get |\n|----------|------|--------------|\n| 🎉 Patreon | [Monthly support](https://patreon.com/LLMfan46) | Priority model requests |\n| ☕ Ko-fi | [One-time tip](https://ko-fi.com/llmfan46) | My eternal gratitude |\n\nYour help will motivate me and would go into further improving my workflow and coverings fees for storage, compute and may even help uncensoring bigger model with rental Cloud GPUs.\n\n-----\n\nGGUF quantizations of [llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic](https://huggingface.co/llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic).\n\n# This is a decensored version of [zerofata/MS3.2-PaintedFantasy-Visage-v3-34B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-Visage-v3-34B), made using [Heretic](https://github.com/p-e-w/heretic) v1.2.0 with the [Arbitrary-Rank Ablation (ARA)](https://github.com/p-e-w/heretic/pull/211) method\n\n## Abliteration parameters\n\n| Parameter | Value |\n| :-------- | :---: |\n| **start_layer_index** | 3 |\n| **end_layer_index** | 29 |\n| **preserve_good_behavior_weight** | 0.8481 |\n| **steer_bad_behavior_weight** | 0.0002 |\n| **overcorrect_relative_weight** | 0.8911 |\n| **neighbor_count** | 5 |\n\n## Targeted components\n\n  * attn.o_proj\n\n## Performance\n\n| Metric | This model | Original model ([MS3.2-PaintedFantasy-Visage-v3-34B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-Visage-v3-34B)) |\n| :----- | :--------: | :---------------------------: |\n| **KL divergence** | <span style=\"color:darkgoldenrod\">0.0195</span> | 0 *(by definition)* |\n| **Refusals** | ✅ <span style=\"color:darkgreen\">4/100</span> | ❌ <span style=\"color:blue\">90/100</span> |\n\n## PIQA test results with batch size 128:\n\n<span style=\"color:blue\">Original:</span>\n\n|Tasks|Version|Filter|n-shot| Metric |   |Value |   |Stderr|\n|-----|------:|------|-----:|--------|---|-----:|---|-----:|\n|piqa |      1|none  |     0|<u>acc</u>     |↑  |**0.8210**|±  |0.0089|\n|     |       |none  |     0|<u>acc_norm</u>|↑  |**0.8313**|±  |0.0087|\n\n<span style=\"color:darkgreen\">Heretic:</span>\n\n|Tasks|Version|Filter|n-shot| Metric |   |Value |   |Stderr|\n|-----|------:|------|-----:|--------|---|-----:|---|-----:|\n|piqa |      1|none  |     0|<u>acc</u>     |↑  |**0.8210**|±  |0.0089|\n|     |       |none  |     0|<u>acc_norm</u>|↑  |**0.8324**|±  |0.0087|\n\nLower refusals indicate fewer content restrictions, while lower KL divergence indicates more closeness to the original model's baseline. Higher refusals cause more rejections, objections, pushbacks, lecturing, censorship, softening and deflections. PIQA (Physical Intuition Question Answering) a ~1,800 questions tests common-sense understanding of how the physical world works with benchmark scores to measure physical reasoning ability. The Heretic model's <u>acc</u> and <u>acc_norm</u> scores closer to the original model's indicate better capability preservation, a big decrease in <u>acc</u> and <u>acc_norm</u> in the <span style=\"color:darkgreen\">Heretic</span> model compared to <span style=\"color:blue\">Original</span> model's results means a big decrease in the Hereticated model capabilities. <u>acc</u> measures raw accuracy (which answer gets higher probability), while <u>acc_norm</u> measures length-normalized accuracy (corrects for answer length bias). For this purpose, <u>acc_norm</u> matters more because longer answers naturally have lower probabilities (more tokens = more chances to lose probability). Without normalization, models favor shorter answers unfairly. <u>acc_norm</u> divides by answer length to correct this.\n\n## MMLU test results with batch size 16:\n\n<span style=\"color:blue\">Original:</span>\n\n|                 Tasks                 |Version|Filter|n-shot|Metric|   |Value |   |Stderr|\n|---------------------------------------|------:|------|-----:|------|---|-----:|---|-----:|\n|mmlu                                   |      2|none  |      |acc   |↑  |0.7763|±  |0.0033|\n| - humanities                          |      2|none  |      |acc   |↑  |0.6948|±  |0.0063|\n|  - formal_logic                       |      1|none  |     0|acc   |↑  |0.5397|±  |0.0446|\n|  - high_school_european_history       |      1|none  |     0|acc   |↑  |0.8485|±  |0.0280|\n|  - high_school_us_history             |      1|none  |     0|acc   |↑  |0.9510|±  |0.0152|\n|  - high_school_world_history          |      1|none  |     0|acc   |↑  |0.9030|±  |0.0193|\n|  - international_law                  |      1|none  |     0|acc   |↑  |0.8926|±  |0.0283|\n|  - jurisprudence                      |      1|none  |     0|acc   |↑  |0.8241|±  |0.0368|\n|  - logical_fallacies                  |      1|none  |     0|acc   |↑  |0.8466|±  |0.0283|\n|  - moral_disputes                     |      1|none  |     0|acc   |↑  |0.8092|±  |0.0212|\n|  - moral_scenarios                    |      1|none  |     0|acc   |↑  |0.4782|±  |0.0167|\n|  - philosophy                         |      1|none  |     0|acc   |↑  |0.8360|±  |0.0210|\n|  - prehistory                         |      1|none  |     0|acc   |↑  |0.8765|±  |0.0183|\n|  - professional_law                   |      1|none  |     0|acc   |↑  |0.5984|±  |0.0125|\n|  - world_religions                    |      1|none  |     0|acc   |↑  |0.8655|±  |0.0262|\n| - other                               |      2|none  |      |acc   |↑  |0.8252|±  |0.0065|\n|  - business_ethics                    |      1|none  |     0|acc   |↑  |0.8100|±  |0.0394|\n|  - clinical_knowledge                 |      1|none  |     0|acc   |↑  |0.8226|±  |0.0235|\n|  - college_medicine                   |      1|none  |     0|acc   |↑  |0.7803|±  |0.0316|\n|  - global_facts                       |      1|none  |     0|acc   |↑  |0.6000|±  |0.0492|\n|  - human_aging                        |      1|none  |     0|acc   |↑  |0.8072|±  |0.0265|\n|  - management                         |      1|none  |     0|acc   |↑  |0.9029|±  |0.0293|\n|  - marketing                          |      1|none  |     0|acc   |↑  |0.9444|±  |0.0150|\n|  - medical_genetics                   |      1|none  |     0|acc   |↑  |0.9000|±  |0.0302|\n|  - miscellaneous                      |      1|none  |     0|acc   |↑  |0.9119|±  |0.0101|\n|  - nutrition                          |      1|none  |     0|acc   |↑  |0.8562|±  |0.0201|\n|  - professional_accounting            |      1|none  |     0|acc   |↑  |0.6383|±  |0.0287|\n|  - professional_medicine              |      1|none  |     0|acc   |↑  |0.8603|±  |0.0211|\n|  - virology                           |      1|none  |     0|acc   |↑  |0.5783|±  |0.0384|\n| - social sciences                     |      2|none  |      |acc   |↑  |0.8739|±  |0.0059|\n|  - econometrics                       |      1|none  |     0|acc   |↑  |0.6667|±  |0.0443|\n|  - high_school_geography              |      1|none  |     0|acc   |↑  |0.9242|±  |0.0189|\n|  - high_school_government_and_politics|      1|none  |     0|acc   |↑  |0.9689|±  |0.0125|\n|  - high_school_macroeconomics         |      1|none  |     0|acc   |↑  |0.8231|±  |0.0193|\n|  - high_school_microeconomics         |      1|none  |     0|acc   |↑  |0.9160|±  |0.0180|\n|  - high_school_psychology             |      1|none  |     0|acc   |↑  |0.9413|±  |0.0101|\n|  - human_sexuality                    |      1|none  |     0|acc   |↑  |0.8702|±  |0.0295|\n|  - professional_psychology            |      1|none  |     0|acc   |↑  |0.8513|±  |0.0144|\n|  - public_relations                   |      1|none  |     0|acc   |↑  |0.8091|±  |0.0376|\n|  - security_studies                   |      1|none  |     0|acc   |↑  |0.8041|±  |0.0254|\n|  - sociology                          |      1|none  |     0|acc   |↑  |0.8905|±  |0.0221|\n|  - us_foreign_policy                  |      1|none  |     0|acc   |↑  |0.9100|±  |0.0288|\n| - stem                                |      2|none  |      |acc   |↑  |0.7545|±  |0.0073|\n|  - abstract_algebra                   |      1|none  |     0|acc   |↑  |0.5600|±  |0.0499|\n|  - anatomy                            |      1|none  |     0|acc   |↑  |0.8519|±  |0.0307|\n|  - astronomy                          |      1|none  |     0|acc   |↑  |0.9079|±  |0.0235|\n|  - college_biology                    |      1|none  |     0|acc   |↑  |0.9306|±  |0.0213|\n|  - college_chemistry                  |      1|none  |     0|acc   |↑  |0.4900|±  |0.0502|\n|  - college_computer_science           |      1|none  |     0|acc   |↑  |0.6800|±  |0.0469|\n|  - college_mathematics                |      1|none  |     0|acc   |↑  |0.5200|±  |0.0502|\n|  - college_physics                    |      1|none  |     0|acc   |↑  |0.5784|±  |0.0491|\n|  - computer_security                  |      1|none  |     0|acc   |↑  |0.8400|±  |0.0368|\n|  - conceptual_physics                 |      1|none  |     0|acc   |↑  |0.8426|±  |0.0238|\n|  - electrical_engineering             |      1|none  |     0|acc   |↑  |0.7793|±  |0.0346|\n|  - elementary_mathematics             |      1|none  |     0|acc   |↑  |0.7804|±  |0.0213|\n|  - high_school_biology                |      1|none  |     0|acc   |↑  |0.9226|±  |0.0152|\n|  - high_school_chemistry              |      1|none  |     0|acc   |↑  |0.7241|±  |0.0314|\n|  - high_school_computer_science       |      1|none  |     0|acc   |↑  |0.8800|±  |0.0327|\n|  - high_school_mathematics            |      1|none  |     0|acc   |↑  |0.5815|±  |0.0301|\n|  - high_school_physics                |      1|none  |     0|acc   |↑  |0.6689|±  |0.0384|\n|  - high_school_statistics             |      1|none  |     0|acc   |↑  |0.7361|±  |0.0301|\n|  - machine_learning                   |      1|none  |     0|acc   |↑  |0.7143|±  |0.0429|\n\n|      Groups      |Version|Filter|n-shot|Metric|   |Value |   |Stderr|\n|------------------|------:|------|------|------|---|-----:|---|-----:|\n|mmlu              |      2|none  |      |acc   |↑  |0.7763|±  |0.0033|\n| - humanities     |      2|none  |      |acc   |↑  |0.6948|±  |0.0063|\n| - other          |      2|none  |      |acc   |↑  |0.8252|±  |0.0065|\n| - social sciences|      2|none  |      |acc   |↑  |0.8739|±  |0.0059|\n| - stem           |      2|none  |      |acc   |↑  |0.7545|±  |0.0073|\n\n<span style=\"color:darkgreen\">Heretic:</span>\n\n|                 Tasks                 |Version|Filter|n-shot|Metric|   |Value |   |Stderr|\n|---------------------------------------|------:|------|-----:|------|---|-----:|---|-----:|\n|mmlu                                   |      2|none  |      |acc   |↑  |0.7711|±  |0.0033|\n| - humanities                          |      2|none  |      |acc   |↑  |0.6869|±  |0.0063|\n|  - formal_logic                       |      1|none  |     0|acc   |↑  |0.5317|±  |0.0446|\n|  - high_school_european_history       |      1|none  |     0|acc   |↑  |0.8485|±  |0.0280|\n|  - high_school_us_history             |      1|none  |     0|acc   |↑  |0.9412|±  |0.0165|\n|  - high_school_world_history          |      1|none  |     0|acc   |↑  |0.9072|±  |0.0189|\n|  - international_law                  |      1|none  |     0|acc   |↑  |0.8760|±  |0.0301|\n|  - jurisprudence                      |      1|none  |     0|acc   |↑  |0.8426|±  |0.0352|\n|  - logical_fallacies                  |      1|none  |     0|acc   |↑  |0.8221|±  |0.0300|\n|  - moral_disputes                     |      1|none  |     0|acc   |↑  |0.8064|±  |0.0213|\n|  - moral_scenarios                    |      1|none  |     0|acc   |↑  |0.4514|±  |0.0166|\n|  - philosophy                         |      1|none  |     0|acc   |↑  |0.8167|±  |0.0220|\n|  - prehistory                         |      1|none  |     0|acc   |↑  |0.8889|±  |0.0175|\n|  - professional_law                   |      1|none  |     0|acc   |↑  |0.5945|±  |0.0125|\n|  - world_religions                    |      1|none  |     0|acc   |↑  |0.8772|±  |0.0252|\n| - other                               |      2|none  |      |acc   |↑  |0.8230|±  |0.0066|\n|  - business_ethics                    |      1|none  |     0|acc   |↑  |0.8000|±  |0.0402|\n|  - clinical_knowledge                 |      1|none  |     0|acc   |↑  |0.8189|±  |0.0237|\n|  - college_medicine                   |      1|none  |     0|acc   |↑  |0.7688|±  |0.0321|\n|  - global_facts                       |      1|none  |     0|acc   |↑  |0.6300|±  |0.0485|\n|  - human_aging                        |      1|none  |     0|acc   |↑  |0.7937|±  |0.0272|\n|  - management                         |      1|none  |     0|acc   |↑  |0.9126|±  |0.0280|\n|  - marketing                          |      1|none  |     0|acc   |↑  |0.9487|±  |0.0145|\n|  - medical_genetics                   |      1|none  |     0|acc   |↑  |0.8900|±  |0.0314|\n|  - miscellaneous                      |      1|none  |     0|acc   |↑  |0.9055|±  |0.0105|\n|  - nutrition                          |      1|none  |     0|acc   |↑  |0.8497|±  |0.0205|\n|  - professional_accounting            |      1|none  |     0|acc   |↑  |0.6348|±  |0.0287|\n|  - professional_medicine              |      1|none  |     0|acc   |↑  |0.8713|±  |0.0203|\n|  - virology                           |      1|none  |     0|acc   |↑  |0.5843|±  |0.0384|\n| - social sciences                     |      2|none  |      |acc   |↑  |0.8684|±  |0.0060|\n|  - econometrics                       |      1|none  |     0|acc   |↑  |0.6579|±  |0.0446|\n|  - high_school_geography              |      1|none  |     0|acc   |↑  |0.9091|±  |0.0205|\n|  - high_school_government_and_politics|      1|none  |     0|acc   |↑  |0.9689|±  |0.0125|\n|  - high_school_macroeconomics         |      1|none  |     0|acc   |↑  |0.8077|±  |0.0200|\n|  - high_school_microeconomics         |      1|none  |     0|acc   |↑  |0.9034|±  |0.0192|\n|  - high_school_psychology             |      1|none  |     0|acc   |↑  |0.9431|±  |0.0099|\n|  - human_sexuality                    |      1|none  |     0|acc   |↑  |0.8550|±  |0.0309|\n|  - professional_psychology            |      1|none  |     0|acc   |↑  |0.8546|±  |0.0143|\n|  - public_relations                   |      1|none  |     0|acc   |↑  |0.7909|±  |0.0390|\n|  - security_studies                   |      1|none  |     0|acc   |↑  |0.7918|±  |0.0260|\n|  - sociology                          |      1|none  |     0|acc   |↑  |0.8905|±  |0.0221|\n|  - us_foreign_policy                  |      1|none  |     0|acc   |↑  |0.9100|±  |0.0288|\n| - stem                                |      2|none  |      |acc   |↑  |0.7507|±  |0.0074|\n|  - abstract_algebra                   |      1|none  |     0|acc   |↑  |0.5700|±  |0.0498|\n|  - anatomy                            |      1|none  |     0|acc   |↑  |0.8296|±  |0.0325|\n|  - astronomy                          |      1|none  |     0|acc   |↑  |0.8947|±  |0.0250|\n|  - college_biology                    |      1|none  |     0|acc   |↑  |0.9167|±  |0.0231|\n|  - college_chemistry                  |      1|none  |     0|acc   |↑  |0.5200|±  |0.0502|\n|  - college_computer_science           |      1|none  |     0|acc   |↑  |0.6800|±  |0.0469|\n|  - college_mathematics                |      1|none  |     0|acc   |↑  |0.5500|±  |0.0500|\n|  - college_physics                    |      1|none  |     0|acc   |↑  |0.6176|±  |0.0484|\n|  - computer_security                  |      1|none  |     0|acc   |↑  |0.8100|±  |0.0394|\n|  - conceptual_physics                 |      1|none  |     0|acc   |↑  |0.8426|±  |0.0238|\n|  - electrical_engineering             |      1|none  |     0|acc   |↑  |0.7793|±  |0.0346|\n|  - elementary_mathematics             |      1|none  |     0|acc   |↑  |0.7804|±  |0.0213|\n|  - high_school_biology                |      1|none  |     0|acc   |↑  |0.9161|±  |0.0158|\n|  - high_school_chemistry              |      1|none  |     0|acc   |↑  |0.6995|±  |0.0323|\n|  - high_school_computer_science       |      1|none  |     0|acc   |↑  |0.8800|±  |0.0327|\n|  - high_school_mathematics            |      1|none  |     0|acc   |↑  |0.5926|±  |0.0300|\n|  - high_school_physics                |      1|none  |     0|acc   |↑  |0.6623|±  |0.0386|\n|  - high_school_statistics             |      1|none  |     0|acc   |↑  |0.7083|±  |0.0310|\n|  - machine_learning                   |      1|none  |     0|acc   |↑  |0.6964|±  |0.0436|\n\n|      Groups      |Version|Filter|n-shot|Metric|   |Value |   |Stderr|\n|------------------|------:|------|------|------|---|-----:|---|-----:|\n|mmlu              |      2|none  |      |acc   |↑  |0.7711|±  |0.0033|\n| - humanities     |      2|none  |      |acc   |↑  |0.6869|±  |0.0063|\n| - other          |      2|none  |      |acc   |↑  |0.8230|±  |0.0066|\n| - social sciences|      2|none  |      |acc   |↑  |0.8684|±  |0.0060|\n| - stem           |      2|none  |      |acc   |↑  |0.7507|±  |0.0074|\n\nMMLU - Massive Multitask Language Understanding, ~14,000 multiple-choice questions across 57 subjects (math, history, law, medicine, etc.).\n\n-----\n\n## Quantizations\n\n| Filename | Quant | Description |\n|----------|-------|-------------|\n| MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-BF16.gguf | BF16 | Full precision |\n| MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q8_0.gguf | Q8_0 | Near-lossless, recommended |\n| MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q6_K.gguf | Q6_K | Excellent quality |\n| MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q5_K_M.gguf | Q5_K_M | Good balance |\n| MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q5_K_S.gguf | Q5_K_S | Smaller Q5 |\n| MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-Q4_K_M.gguf | Q4_K_M | Good for limited VRAM |\n\n## Usage\n\nWorks with llama.cpp, LM Studio, Ollama, and other GGUF-compatible tools.\n\n-----\n\n<style>\n.container {\n  --primary-accent: #C0C0C0;\n  --secondary-accent: #4A9EFF;\n  --glow-primary: rgba(192, 192, 192, 0.6);\n  --glow-secondary: rgba(74, 158, 255, 0.6);\n  \n  --bg-main: #0B0A18;\n  --bg-container: #110F24;\n  --bg-card: rgba(20, 18, 40, 0.7);\n  \n  --text-main: #DCDCDC;\n  --text-muted: #9E9E9E;\n  --white: #FFFFFF;\n  --border-color: #3C3A50;\n  \n  --font-title: 'Cinzel', serif;\n  --font-body: 'EB Garamond', serif;\n  --font-code: 'Courier New', monospace;\n\n  font-family: var(--font-body);\n  color: var(--text-main);\n  line-height: 1.6;\n  font-weight: 400;\n  \n  max-width: 1100px;\n  margin: 20px auto;\n  padding: 25px;\n  background-color: var(--bg-main);\n  background-image: linear-gradient(rgba(11, 10, 24, 0.95), rgba(11, 10, 24, 0.95)), url('https://www.transparenttextures.com/patterns/stardust.png');\n  min-height: calc(100vh - 40px);\n  \n  border-radius: 8px;\n  box-shadow: 0 0 25px rgba(0,0,0,0.7);\n  border: 1px solid var(--border-color);\n}\n\n.container .title-container {\n  background: linear-gradient(135deg, rgba(20, 18, 40, 0.8), rgba(30, 28, 50, 0.6));\n  margin-bottom: 30px;\n  border: 1px solid var(--border-color);\n  border-radius: 6px;\n  padding: 25px;\n  text-align: center;\n  position: relative;\n  box-shadow: 0 5px 15px rgba(0,0,0,0.4);\n  overflow: hidden;\n}\n\n.container .title-main {\n  color: var(--white);\n  font-size: 2.5rem;\n  font-weight: 700;\n  margin: 0;\n  letter-spacing: 4px;\n  display: block;\n  text-transform: uppercase;\n  text-shadow: 0 0 4px var(--glow-primary), 0 0 8px var(--glow-primary), 0 0 12px var(--glow-primary);\n  font-family: var(--font-title);\n}\n\n.container .lemonade-text {\n    color: var(--secondary-accent);\n    text-shadow: 0 0 8px var(--glow-secondary);\n}\n\n.container .title-subtitle {\n  padding-left: 0;\n  margin-top: 15px;\n}\n\n.container .subtitle-text {\n  color: var(--text-muted);\n  font-size: 1.2rem;\n  font-family: var(--font-body);\n  font-style: italic;\n  font-weight: 400;\n  letter-spacing: 2px;\n  text-transform: uppercase;\n  opacity: 0.8;\n}\n\n.container img {\n  max-width: 100%;\n  border: 2px solid var(--border-color);\n  margin-bottom: 40px;\n  box-shadow: 0 5px 15px rgba(0,0,0,0.5);\n  border-radius: 4px;\n}\n\n.container .section-container {\n  margin-bottom: 25px;\n  padding-bottom: 25px;\n  border-bottom: 1px dashed var(--border-color);\n}\n.container .section-container:last-of-type {\n    border-bottom: none;\n    padding-bottom: 0;\n    margin-bottom: 0;\n}\n\n.container .section-header {\n  display: flex;\n  align-items: center;\n  padding: 0 0 15px 0;\n}\n\n.container .section-title {\n  font-family: var(--font-title);\n  background: linear-gradient(45deg, var(--secondary-accent), var(--primary-accent));\n  background-clip: text;\n  -webkit-background-clip: text;\n  -webkit-text-fill-color: transparent;\n  font-size: 1.4rem;\n  margin: 0 !important;\n  padding: 0 0 10px 0 !important;\n  letter-spacing: 1px;\n  font-weight: 700;\n  text-transform: uppercase;\n  border: none !important;\n  position: relative;\n  display: inline-block;\n}\n\n.container .section-title::after {\n   content: '';\n   position: absolute;\n   bottom: 0;\n   left: 0;\n   width: 100%;\n   height: 2px;\n   background-image: linear-gradient(to right, var(--secondary-accent), var(--primary-accent));\n   box-shadow: 0 0 6px var(--glow-secondary), 0 0 6px var(--glow-primary);\n   border-radius: 2px;\n}\n\n.container .section-content {\n    padding: 20px 0 0 0;\n}\n\n.container .subheading {\n  color: var(--secondary-accent);\n  font-size: 1.1rem;\n  margin-top: 20px;\n  margin-bottom: 12px;\n  font-weight: 700;\n  display: block;\n  text-transform: uppercase;\n  letter-spacing: 2px;\n  font-family: var(--font-title);\n  border-bottom: 1px solid var(--secondary-accent);\n  padding-bottom: 6px;\n  text-shadow: 0 0 4px var(--glow-secondary);\n}\n\n.container .data-box {\n  background-color: var(--bg-card);\n  padding: 15px;\n  border: 1px solid var(--border-color);\n  border-left: 2px solid var(--primary-accent);\n  margin-bottom: 15px;\n  box-shadow: inset 0 0 6px rgba(0,0,0,0.4);\n  border-radius: 4px;\n  font-size: 1rem;\n}\n\n.container .data-row {\n  display: flex;\n  align-items: center;\n  margin-bottom: 6px;\n  padding: 5px 0;\n}\n\n.container .data-row:last-child {\n  margin-bottom: 0;\n}\n\n.container .data-arrow {\n  color: var(--secondary-accent);\n  font-weight: bold;\n  margin-right: 10px;\n  font-family: var(--font-code);\n  font-size: 1rem;\n}\n\n.container .data-label {\n  color: var(--white);\n  font-weight: 600;\n  font-family: var(--font-body);\n  margin-right: 8px;\n  min-width: 80px;\n}\n\n.container a {\n  color: var(--primary-accent);\n  text-decoration: none;\n  font-weight: 600;\n  transition: all .2s;\n}\n\n.container .data-row a {\n  border-bottom: 1px dotted var(--primary-accent);\n}\n\n.container a:hover {\n  text-decoration: none;\n  color: var(--white);\n  text-shadow: 0 0 5px var(--glow-primary);\n}\n\n.container .data-row a:hover {\n  border-bottom-style: solid;\n}\n\n.container .dropdown-container {\n  margin-top: 20px;\n}\n\n.container .dropdown-summary {\n  cursor: pointer;\n  padding: 10px 0;\n  color: var(--text-muted);\n  font-size: 1.1rem;\n  font-weight: 700;\n  text-transform: none;\n  font-family: var(--font-title);\n  letter-spacing: 1px;\n  list-style: none;\n  transition: color 0.2s ease;\n}\n.container .dropdown-summary:hover {\n    color: var(--primary-accent);\n}\n\n.container .dropdown-arrow {\n  color: var(--secondary-accent);\n  margin-right: 10px;\n  transition: transform 0.2s ease;\n}\n\n.container .dropdown-content {\n  margin-top: 15px;\n  padding: 20px;\n  background-color: var(--bg-card);\n  border: 1px solid var(--border-color);\n  border-radius: 4px;\n}\n\n.container .config-title {\n  color: var(--text-muted);\n  font-size: 1rem;\n  margin-bottom: 10px;\n  font-family: var(--font-body);\n  text-transform: uppercase;\n  letter-spacing: 1px;\n  font-weight: 700;\n}\n\n.container pre {\n  background-color: #1c1c1c;\n  padding: 15px;\n  border: 1px solid var(--border-color);\n  white-space: pre-wrap;\n  word-wrap: break-word;\n  color: #c5c8c6;\n  border-radius: 4px;\n  box-shadow: inset 0 0 5px rgba(0,0,0,0.5);\n}\n\n.container pre code {\n  background: none;\n  color: inherit;\n  padding: 0;\n  border-radius: 0;\n}\n\n.container code {\n  font-family: var(--font-code);\n  color: var(--primary-accent);\n  background: var(--border-color);\n  padding: 2px 5px;\n  border-radius: 4px;\n}\n</style>\n<html lang=\"en\">\n<head>\n  <meta charset=\"UTF-8\">\n  <meta name=\"viewport\" content=\"width=device-width, initial-scale=1.0\">\n  <title>Painted Fantasy</title>\n  <link rel=\"preconnect\" href=\"https://fonts.googleapis.com\">\n  <link rel=\"preconnect\" href=\"https://fonts.gstatic.com\" crossorigin>\n  <link href=\"https://fonts.googleapis.com/css2?family=Cinzel:wght@400;700&family=MedievalSharp&family=EB+Garamond:ital,wght@0,400;0,500;1,400&display=swap\" rel=\"stylesheet\">\n</head>\n<body>\n\n<div class=\"container\">\n  <div class=\"title-container\">\n    <div class=\"glitchy-overlay\"></div>\n    <div class=\"title-wrapper\">\n      <h1 class=\"title-main\">\n        <span class=\"title-prefix\">PAINTED FANTASY</span>\n        <span class=\"lemonade-text\">VISAGE v3</span>\n      </h1>\n      <div class=\"title-subtitle\">\n        <span class=\"subtitle-text\">Mistral Small 3.2 Upscaled 34B</span>\n      </div>\n    </div>\n  </div>\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/65b19c6c638328850e12d38c/CroIkC3MXC5gIghNjkEVg.png)\n\n  <div class=\"section-container\">\n    <div class=\"section-header\">\n      <div class=\"section-indicator\"></div>\n      <h2 class=\"section-title\">Overview</h2>\n    </div>\n    <div class=\"section-content\">\n      <p>No layer left behind edition.</p>\n      <p>Upscale redone with the missing final layer included. The original upscales were always missing a layer, but I never troubleshooted to identify *what* layer was missing. Turns out it was the final layer. That's kind of an important one.</p>\n      <p>This model is an uncensored, creative writing and RP model. Compared to the older version, it is smarter and I think has a bit less repetition. The old V2 version though is slightly more creative due to the instability it had.</p>\n    </div>\n  </div>\n\n  <div class=\"section-container\">\n    <div class=\"section-header\">\n      <div class=\"section-indicator\"></div>\n      <h2 class=\"section-title\">SillyTavern Settings</h2>\n    </div>\n    <div class=\"section-content\">\n      <h3 class=\"subheading\">Recommended Roleplay Format</h3>\n      <div class=\"data-box\">\n        <div class=\"data-row\">\n            <span class=\"data-arrow\">></span>\n            <span class=\"data-label\">Actions:</span>\n            <span>In plaintext</span>\n        </div>\n      <div class=\"data-row\">\n            <span class=\"data-arrow\">></span>\n            <span class=\"data-label\">Dialogue:</span>\n            <span>\"In quotes\"</span>\n      </div>\n      <div class=\"data-row\">\n            <span class=\"data-arrow\">></span>\n            <span class=\"data-label\">Thoughts:</span>\n            <span>*In asterisks*</span>\n      </div>\n      </div>\n      <h3 class=\"subheading\">Recommended Samplers</h3>\n      <div class=\"data-box\">\n        <div class=\"data-row\">\n          <span class=\"data-arrow\">></span>\n          <span class=\"data-label\">Temp:</span>\n          <span>0.7-0.8</span>\n        </div>\n        <div class=\"data-row\">\n          <span class=\"data-arrow\">></span>\n          <span class=\"data-label\">MinP:</span>\n          <span>0.05 - 0.1</span>\n        </div>\n        <div class=\"data-row\">\n          <span class=\"data-arrow\">></span>\n          <span class=\"data-label\">TopP:</span>\n          <span>0.95</span>\n        </div>\n        <div class=\"data-row\">\n          <span class=\"data-arrow\">></span>\n          <span class=\"data-label\">Dry:</span>\n          <span>0.8, 1.75, 4</span>\n        </div>\n      </div>\n      <h3 class=\"subheading\">Instruct</h3>\n      <div class=\"data-box\">\n        <p style=\"margin: 0;\">Mistral v7 Tekken</p>\n      </div>\n    </div>\n  </div>\n\n  <div class=\"section-container\">\n    <div class=\"section-header\">\n      <div class=\"section-indicator\"></div>\n      <h2 class=\"section-title\">Quantizations</h2>\n    </div>\n    <div class=\"section-content\">\n      <div style=\"margin-bottom: 20px;\">\n        <h3 class=\"subheading\">GGUF</h3>\n        <div class=\"data-box\">\n          <div class=\"data-row\">\n            <span class=\"data-arrow\">></span>\n            <a href=\"https://huggingface.co/bartowski/zerofata_MS3.2-PaintedFantasy-Visage-v3-34B-GGUF\">iMatrix (bartowski)</a>\n          </div>\n        </div>\n      </div>\n      <div>\n        <h3 class=\"subheading\">EXL3</h3>\n        <div class=\"data-box\">\n          <div class=\"data-row\">\n            <span class=\"data-arrow\">></span>\n            <a href=\"https://huggingface.co/zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-3bpw\">3bpw</a>\n          </div>\n          <div class=\"data-row\">\n            <span class=\"data-arrow\">></span>\n            <a href=\"https://huggingface.co/zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-4bpw\">4bpw</a>\n          </div>\n          <div class=\"data-row\">\n            <span class=\"data-arrow\">></span>\n            <a href=\"https://huggingface.co/zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-4.25bpw\">4.25bpw</a>\n          </div>\n          <div class=\"data-row\">\n            <span class=\"data-arrow\">></span>\n            <a href=\"https://huggingface.co/zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-5bpw\">5bpw</a>\n          </div>\n          <div class=\"data-row\">\n            <span class=\"data-arrow\">></span>\n            <a href=\"https://huggingface.co/zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-6bpw\">6bpw</a>\n          </div>\n        </div>\n      </div>\n    </div>\n  </div>\n\n  <div class=\"section-container\">\n    <div class=\"section-header\">\n      <div class=\"section-indicator\"></div>\n      <h2 class=\"section-title\">Creation Process</h2>\n    </div>\n    <div class=\"section-content\">\n      <p>Creation Process: Upscale > CPT > SFT > DPO</p>\n      <p>Pretrained on approx 300MB of light novel and FineWeb-2 corpus.</p>\n      <p>SFT on approx 8 million tokens, SFW / NSFW RP, stories and creative instruct data.</p>\n      <p>DPO on a high quality RP / NSFW dataset with a focus on improving instruction following, reducing repetition and fixing common model mistakes.</p>\n              <div class=\"dropdown-container\">\n          <details>\n            <summary class=\"dropdown-summary\">\n              <span class=\"dropdown-arrow\">></span>\n              Mergekit configs\n            </summary>\n            <div class=\"dropdown-content\">\n              <p>Merge configurations used during the model creation process.</p>\n              <div class=\"config-title\">Upscale (Passthrough)</div>\n              <pre><code>base_model: ConicCat/Mistral-Small-3.2-AntiRep-24B\nmerge_method: passthrough\ndtype: bfloat16\nslices:\n  - sources:\n      - model: ConicCat/Mistral-Small-3.2-AntiRep-24B\n        layer_range: [0, 29]\n  - sources:\n      - model: ConicCat/Mistral-Small-3.2-AntiRep-24B\n        layer_range: [10, 40]</code></pre>\n            </div>\n          </details>\n        </div>\n        <div class=\"dropdown-container\">\n          <details>\n            <summary class=\"dropdown-summary\">\n              <span class=\"dropdown-arrow\">></span>\n              Axolotl configs\n            </summary>\n          <div class=\"dropdown-content\">\n            <p>Not optimized for cost / performance efficiency, YMMV.</p>\n            <div class=\"config-title\">Pretrain 4*H100</div>\n            <pre><code>&#35; ====================\n&#35; MODEL CONFIGURATION\n&#35; ====================\nbase_model: ../mergekit/pf_v3_upscale\nmodel_type: MistralForCausalLM\ntokenizer_type: AutoTokenizer\nchat_template: mistral_v7_tekken\n&#35; ====================\n&#35; DATASET CONFIGURATION\n&#35; ====================\ndatasets:\n  - path: ./data/pretrain_dataset_v5_stripped.jsonl\n    type: completion\n<br>\ndataset_prepared_path:\ntrain_on_inputs: false  &#35; Only train on assistant responses\n<br>\n&#35; ====================\n&#35; QLORA CONFIGURATION\n&#35; ====================\nadapter: qlora\nload_in_4bit: true\nlora_r: 32\nlora_alpha: 64\nlora_dropout: 0.05\nlora_target_linear: true\n&#35; lora_modules_to_save:  &#35; Uncomment only if you added NEW tokens\n<br>\n&#35; ====================\n&#35; TRAINING PARAMETERS\n&#35; ====================\nnum_epochs: 1\nmicro_batch_size: 4\ngradient_accumulation_steps: 1\nlearning_rate: 4e-5\noptimizer: paged_adamw_8bit\nlr_scheduler: rex\nwarmup_ratio: 0.05\nweight_decay: 0.01\nmax_grad_norm: 1.0\n<br>\n&#35; ====================\n&#35; SEQUENCE &amp; PACKING\n&#35; ====================\nsequence_len: 12288\nsample_packing: true\neval_sample_packing: false\npad_to_sequence_len: true\n<br>\n&#35; ====================\n&#35; HARDWARE OPTIMIZATIONS\n&#35; ====================\nbf16: auto\nflash_attention: true\ngradient_checkpointing: offload\ndeepspeed: deepspeed_configs/zero1.json\n<br>\nplugins:\n  - axolotl.integrations.liger.LigerPlugin\n  - axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin\ncut_cross_entropy: true\nliger_rope: true\nliger_rms_norm: true\nliger_layer_norm: true\nliger_glu_activation: true\nliger_cross_entropy: false  &#35; Cut Cross Entropy overrides this\nliger_fused_linear_cross_entropy: false  &#35; Cut Cross Entropy overrides this\n<br>\n&#35; ====================\n&#35; EVALUATION &amp; CHECKPOINTING\n&#35; ====================\nsave_strategy: steps\nsave_steps: 40\nsave_total_limit: 5  &#35; Keep best + last few checkpoints\nload_best_model_at_end: true\ngreater_is_better: false\n<br>\n&#35; ====================\n&#35; LOGGING &amp; OUTPUT\n&#35; ====================\noutput_dir: ./Visage-V3-PT-1\nlogging_steps: 2\nsave_safetensors: true\n<br>\n&#35; ====================\n&#35; WANDB TRACKING\n&#35; ====================\nwandb_project: Visage-V3-PT\n# wandb_entity: your_entity\nwandb_name: Visage-V3-PT-1</code></pre>\n            <div class=\"config-title\">SFT 4*H100</div>\n            <pre><code># ====================\n# MODEL CONFIGURATION\n# ====================\nbase_model: ./Visage-V3-PT-1/merged\nmodel_type: MistralForCausalLM\ntokenizer_type: AutoTokenizer\nchat_template: mistral_v7_tekken\n<br>\n# ====================\n# DATASET CONFIGURATION\n# ====================\ndatasets:\n  - path: ./data/dataset.jsonl\n    type: chat_template\n    split: train\n    chat_template_strategy: tokenizer\n    field_messages: messages\n    message_property_mappings:\n      role: role\n      content: content\n    roles:\n      user: [\"user\"]\n      assistant: [\"assistant\"]\n      system: [\"system\"]\n<br>\ndataset_prepared_path:\ntrain_on_inputs: false  # Only train on assistant responses\n<br>\n# ====================\n# QLORA CONFIGURATION\n# ====================\nadapter: qlora\nload_in_4bit: true\nlora_r: 128\nlora_alpha: 128\nlora_dropout: 0.1\nlora_target_linear: true\n# lora_modules_to_save:  # Uncomment only if you added NEW tokens\n<br>\n# ====================\n# TRAINING PARAMETERS\n# ====================\nnum_epochs: 3\nmicro_batch_size: 4\ngradient_accumulation_steps: 1\nlearning_rate: 1e-5\noptimizer: paged_adamw_8bit\nlr_scheduler: rex\nwarmup_ratio: 0.05\nweight_decay: 0.01\nmax_grad_norm: 1.0\n<br>\n# ====================\n# SEQUENCE & PACKING\n# ====================\nsequence_len: 8192\nsample_packing: true\npad_to_sequence_len: true\n<br>\n# ====================\n# HARDWARE OPTIMIZATIONS\n# ====================\nbf16: auto\nflash_attention: true\ngradient_checkpointing: offload\ndeepspeed: deepspeed_configs/zero1.json\n<br>\nplugins:\n  - axolotl.integrations.liger.LigerPlugin\n  - axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin\ncut_cross_entropy: true\nliger_rope: true\nliger_rms_norm: true\nliger_layer_norm: true\nliger_glu_activation: true\nliger_cross_entropy: false  # Cut Cross Entropy overrides this\nliger_fused_linear_cross_entropy: false  # Cut Cross Entropy overrides this\n<br>\n# ====================\n# EVALUATION & CHECKPOINTING\n# ====================\nsave_strategy: steps\nsave_steps: 20\nsave_total_limit: 5  # Keep best + last few checkpoints\nload_best_model_at_end: true\nmetric_for_best_model: eval_loss\ngreater_is_better: false\n<br>\n# ====================\n# LOGGING & OUTPUT\n# ====================\noutput_dir: ./Visage-V3-PT-1-SFT-2\nlogging_steps: 1\nsave_safetensors: true\n<br>\n# ====================\n# WANDB TRACKING\n# ====================\nwandb_project: Visage-V3-SFT\n# wandb_entity: your_entity\nwandb_name: Visage-V3-PT-1-SFT-2</code></pre>\n            <div class=\"config-title\">DPO 2*H200</div>\n            <pre><code># ====================\n# MODEL CONFIGURATION\n# ====================\nbase_model: ./Visage-V3-PT-1-SFT-2/merged\nmodel_type: MistralForCausalLM\ntokenizer_type: AutoTokenizer\nchat_template: mistral_v7_tekken\n<br>\n# ====================\n# RL/DPO CONFIGURATION\n# ====================\nrl: dpo\nrl_beta: 0.085\n<br>\n# ====================\n# DATASET CONFIGURATION\n# ====================\ndatasets:\n  - path: ./data/handcrafted_dataset_mistral_rep.jsonl\n    type: chat_template.default\n    field_messages: messages\n    field_chosen: chosen\n    field_rejected: rejected\n    message_property_mappings:\n      role: role\n      content: content\n    roles:\n      system: [\"system\"]\n      user: [\"user\"]\n      assistant: [\"assistant\"]\n  - path: ./data/approved_automated_l3_dataset.jsonl\n    type: chat_template.default\n    field_messages: messages\n    field_chosen: chosen\n    field_rejected: rejected\n    message_property_mappings:\n      role: role\n      content: content\n    roles:\n      system: [\"system\"]\n      user: [\"user\"]\n      assistant: [\"assistant\"]\ndataset_prepared_path:\ntrain_on_inputs: false  # Only train on assistant responses\n<br>\n# ====================\n# QLORA CONFIGURATION\n# ====================\nadapter: lora\nload_in_8bit: true\nlora_r: 16\nlora_alpha: 32\nlora_dropout: 0.1\nlora_target_linear: true\n# lora_modules_to_save:  # Uncomment only if you added NEW tokens\n<br>\n# ====================\n# TRAINING PARAMETERS\n# ====================\nnum_epochs: 1\nmicro_batch_size: 2\ngradient_accumulation_steps: 4\nlearning_rate: 2e-6\noptimizer: adamw_torch_fused\nlr_scheduler: cosine\nwarmup_steps: 5\nweight_decay: 0.01\nmax_grad_norm: 1.0\n<br>\n# ====================\n# SEQUENCE CONFIGURATION\n# ====================\nsequence_len: 8192\npad_to_sequence_len: true\n<br>\n# ====================\n# HARDWARE OPTIMIZATIONS\n# ====================\nbf16: auto\ntf32: false\nflash_attention: true\ngradient_checkpointing: offload\n<br>\nplugins:\n  - axolotl.integrations.liger.LigerPlugin\n  - axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin\ncut_cross_entropy: true\nliger_rope: true\nliger_rms_norm: true\nliger_layer_norm: true\nliger_glu_activation: true\nliger_cross_entropy: false  # Cut Cross Entropy overrides this\nliger_fused_linear_cross_entropy: false  # Cut Cross Entropy overrides this\ndeepspeed: deepspeed_configs/zero1.json\n<br>\n# ====================\n# CHECKPOINTING\n# ====================\nsave_steps: 10\nsave_total_limit: 10\nload_best_model_at_end: true\nmetric_for_best_model: eval_loss\ngreater_is_better: false\n<br>\n# ====================\n# LOGGING & OUTPUT\n# ====================\noutput_dir: ./Visage-V3-PT-1-SFT-2-DPO-2\nlogging_steps: 1\nsave_safetensors: true\n<br>\n# ====================\n# WANDB TRACKING\n# ====================\nwandb_project: Visage-V3-DPO\n# wandb_entity: your_entity\nwandb_name: Visage-V3-PT-1-SFT-2-DPO-2</code></pre>\n          </div>\n        </details>\n      </div>\n    </div>\n  </div>\n</div>\n</body>\n</html>",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "heretic",
    "uncensored",
    "decensored",
    "abliterated",
    "ara",
    "dataset:zerofata/Instruct-Anime",
    "dataset:zerofata/Instruct-Anime-CreativeWriting",
    "dataset:zerofata/Roleplay-Anime-Characters",
    "dataset:zerofata/Summaries-Anime-FandomPages",
    "base_model:llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic",
    "base_model:quantized:llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 517,
  "gated": false,
  "private": false,
  "last_modified": "2026-03-27T19:49:45.000Z",
  "created_at": "2026-03-27T19:19:49.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "69c6d855e8dbb9d3843751c7",
  "id": "llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-GGUF",
  "modelId": "llmfan46/MS3.2-PaintedFantasy-Visage-v3-34B-ultra-uncensored-heretic-GGUF",
  "sha": "0aa30b1d0fe3693aaa652444a014b38be3dad36c",
  "createdAt": "2026-03-27T19:19:49.000Z",
  "lastModified": "2026-03-27T19:49:45.000Z",
  "author": "llmfan46",
  "downloads": 517,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 8
}