---

tags:

• gguf
• llama.cpp
• llama-cpp
• heretic
• uncensored
• smollm3

license: apache-2.0

base_model:

• K0D3IN/SmolLM3-3B-Instruct-heretic

---

SmolLM3-3B-Instruct-heretic : GGUF

Community static quants in GGUF format of K0D3IN/SmolLM3-3B-Instruct-heretic.

Available model files:

• SmolLM3-3B-Instruct-heretic.Q2_K_L.gguf
• SmolLM3-3B-Instruct-heretic.Q3_K_M.gguf
• SmolLM3-3B-Instruct-heretic.Q4_K_M.gguf
• SmolLM3-3B-Instruct-heretic.Q5_K_M.gguf
• SmolLM3-3B-Instruct-heretic.Q6_K.gguf
• SmolLM3-3B-Instruct-heretic.Q8_0.gguf

---

SmolLM3-3B-Instruct-Heretic

This repository contains a surgically de-censored version of HuggingFaceTB's SmolLM3 3B Instruct model, optimized via weight abliteration techniques. By applying the heretic framework across an extensive 1000-trial search space, we successfully isolated and neutralized the primary refusal vectors embedded within the attn.o_proj and mlp.down_proj layers.

Abliteration Parameters:

| Parameter | Value |

| :------------------------------------ | :---: |

| direction_index | 18.58 |

| attn.o_proj.max_weight | 1.05 |

| attn.o_proj.max_weight_position | 30.38 |

| attn.o_proj.min_weight | 1.02 |

| attn.o_proj.min_weight_distance | 18.73 |

| mlp.down_proj.max_weight | 1.46 |

| mlp.down_proj.max_weight_position | 30.34 |

| mlp.down_proj.min_weight | 1.24 |

| mlp.down_proj.min_weight_distance | 19.77 |

Highlights & Metrics

| Metric | This model | Original model (HuggingFaceTB/SmolLM3-3B-Instruct) |

| :---------------: | :--------: | :----------------------------------------------------------------------------------------------------------: |

| KL Divergence | 0.0491 | 0 (By definition) |

| Refusals | 4/100 | 99/100 |

• Optimal Balance: Selected Trial 317 out of 1000 iterations for the perfect trade-off between freedom and reasoning capabilities.

• Refusal Rate: Dropped down to 4/100 (from the original near-total refusal on safety benchmarks).

• KL Divergence: 0.0491 - Demonstrates that general language capabilities are preserved relative to the original model. However, safety-aligned weights in attn.o_proj and mlp.down_proj have been surgically removed; this is intentional modification, not unintended degradation.

Benchmark Results

Benchmark evaluations will be added soon once evaluation pipeline is completed.

Technical Implementation Notes

Unlike aggressive fine-tuning which often degrades the model's core logic or shifts its grammar distributions, this weight manipulation directly zeros out the activation steering directions that cause alignment blocks.

Direction Index: 18.58 (Static allocation)*

Retained Capabilities: Excellent at structured JSON outputs, creative writing, coding logic and tool usage without preachy moral lectures.

Thinking Mode: This model retains its full thinking capabilities including structured <think> </think> reasoning blocks. Abliteration does not affect the thinking mechanism.

CRITICAL SAFETY NOTICE

This model has had its safety mechanisms surgically removed.

This is NOT a safe model for deployment. The refusal mechanisms that normally prevent harmful outputs have been abliterated. This model:

WILL generate:

• Detailed instructions for illegal activities (drug synthesis, weapons, hacking)
• Hateful, discriminatory, and abusive content
• Graphic violence and sexual abuse material descriptions
• Misinformation and harmful medical/legal advice
• Phishing, social engineering, and scam tactics
• Content violating laws in multiple jurisdictions

DOES NOT:

• Refuse harmful requests (4/100 refusal rate)
• Implement safety guardrails
• Consider ethical implications
• Respect content policies

APPROPRIATE USE CASES (ONLY):

• Adversarial research on AI alignment and jailbreak vectors
• Red-teaming and vulnerability disclosure by trained security researchers
• Academic safety research with institutional ethics review
• Understanding failure modes in alignment techniques

INAPPROPRIATE USE:

• Production deployments
• User-facing applications
• Creating harmful content at scale
• Bypassing security measures in systems
• Any use case intended to cause harm

Legal Disclaimer: Users are solely responsible for downstream use. Deploying this model in violation of applicable laws or terms of service is illegal and unethical.

---

Support Open Source AI Research

Every donation helps. Consider supporting this work:

- Monero (XMR):

83iqXtvVu28ZiL9bsATMerSgbFFiD1J1jc96CcxJLEnAW3KBmBKedWnUAeLvLvEA9aBiUBpHQJs1iNHYtkTLZbNUEymobSS

- Bitcoin (BTC):

bc1qmnlvpukcgl0hsr7nje0x8555mhtxjt80wtmlxm