GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

Dzluck/gemma-4-E2B-it-uncensored-GGUF overview

gemma 4 E2B it uncensored GGUF GGUF quantizations of TrevorJS/gemma 4 E2B it uncensored https://huggingface.co/TrevorJS/gemma 4 E2B it uncensored . Files | Fil…

ggufabliterationuncensoredgemma-4text-generationenbase_model:TrevorJS/gemma-4-E2B-it-uncensoredbase_model:quantized:TrevorJS/gemma-4-E2B-it-uncensoredlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~3.19 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
gemma-4-E2B-it-uncensored-Q4_K_M.ggufGGUFQ4_K_M3.19 GBDownload
gemma-4-E2B-it-uncensored-Q8_0.ggufGGUFQ8_04.63 GBDownload

Model Details

Model IDDzluck/gemma-4-E2B-it-uncensored-GGUF
AuthorDzluck
Pipelinetext-generation
Licenseapache-2.0
Base modelTrevorJS/gemma-4-E2B-it-uncensored
Last modified2026-06-19T04:32:27.000Z

Model README

---

base_model: TrevorJS/gemma-4-E2B-it-uncensored

base_model_relation: quantized

pipeline_tag: text-generation

language:

  • en

license: apache-2.0

tags:

  • abliteration
  • uncensored
  • gemma-4
  • gguf

---

gemma-4-E2B-it-uncensored (GGUF)

GGUF quantizations of TrevorJS/gemma-4-E2B-it-uncensored.

Files

| File | Quant | Size |

|------|-------|------|

| gemma-4-E2B-it-uncensored-Q4_K_M.gguf | Q4_K_M | 3.4 GB |

| gemma-4-E2B-it-uncensored-Q8_0.gguf | Q8_0 | 5.0 GB |

Usage

# From HuggingFace (auto-downloads)
llama-server -hf TrevorJS/gemma-4-E2B-it-uncensored-GGUF -c 8192

# From local file
llama-server -m gemma-4-E2B-it-uncensored-Q4_K_M.gguf -c 8192

Then open http://localhost:8080 for the chat UI.

Details

These are GGUF quantizations of TrevorJS/gemma-4-E2B-it-uncensored, an abliterated

(uncensored) version of google/gemma-4-E2B-it.

Refusal behavior has been removed using norm-preserving biprojected abliteration.

See the bf16 model card for full method details,

before/after refusal rates, and cross-dataset validation results.

Source code: TrevorJS/gemma-4-abliteration

Run Dzluck/gemma-4-E2B-it-uncensored-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models