GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

asmanovlev/veriloop-coder-e1-heretic-i1-GGUF overview

VeriLoop Coder E1 — Abliterated i1, imatrix GGUF GGUF quants of VeriLoop Coder E1 Qwen3.6 27B, coding tuned with the refusal direction abliterated heretic / Lo…

ggufimatrixabliteratedqwen3.6codingtext-generationenbase_model:tsinghua-sigs-robot-lab/veriloop-coder-e1base_model:quantized:tsinghua-sigs-robot-lab/veriloop-coder-e1license:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~7.85 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
10
Likes
0
Pipeline
text-generation

Repository Files & Downloads

5 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
VeriLoop-Coder-E1-Abliterated-Q8_0.ggufGGUFQ8_026.63 GBDownload
abl_iq2_xxs.ggufGGUFIQ2_XXS7.85 GBDownload
abl_iq3_xxs.ggufGGUFIQ3_XXS10.42 GBDownload
abl_iq4_nl.ggufGGUFIQ4_NL14.72 GBDownload
abl_iq4_xs.ggufGGUFIQ4_XS14.05 GBDownload

Model Details

Model IDasmanovlev/veriloop-coder-e1-heretic-i1-GGUF
Authorasmanovlev
Pipelinetext-generation
Licenseapache-2.0
Base modeltsinghua-sigs-robot-lab/veriloop-coder-e1
Last modified2026-08-02T19:23:51.000Z

Model README

---

license: apache-2.0

base_model: tsinghua-sigs-robot-lab/veriloop-coder-e1

language:

- en

tags:

- gguf

- imatrix

- abliterated

- qwen3.6

- coding

- text-generation

---

VeriLoop Coder E1 — Abliterated (i1, imatrix) GGUF

GGUF quants of VeriLoop Coder E1 (Qwen3.6-27B, coding-tuned) with the refusal direction abliterated (heretic / LoRA-merge), quantized with imatrix importance calibration.

⚠️ What "abliterated" means here

  • The model was run through heretic v1.4.0 (200 trials) with --export-strategy=ADAPTER, then the LoRA was merged into the base weights.
  • Partial abliteration: refusal rate dropped from ~95% to 82/100 on harmful_behaviors. The model is less censorious but still refuses many requests — Qwen 3.6's four PEFT-adapters distribute refusal patterns across multiple subspaces, so a single direction was hard to find.
  • KL divergence ≈ 0.0003 — general capability is preserved; only the refusal direction is nudged.
  • Use at your own discretion; the weights are provided as-is.

Files

| File | Quant | Size | Notes |

|------|-------|------|-------|

| VeriLoop-Coder-E1-Abliterated-Q8_0.gguf | Q8_0 | 26.6 GB | Reference (no imatrix needed) |

| abl_iq4_nl.gguf | IQ4_NL | 14.7 GB | Best quality/size balance |

| abl_iq4_xs.gguf | IQ4_XS | 14.1 GB | Faster, slightly lower quality |

| abl_iq3_xxs.gguf | IQ3_XXS | 10.4 GB | Good for 12-16 GB VRAM |

| abl_iq2_xxs.gguf | IQ2_XXS | 7.9 GB | Fits 8 GB VRAM, quality drops |

| imatrix.dat | — | 10 MB | Importance matrix used for IQ quants |

All IQ quants were produced with the included imatrix.dat (code-focused calibration dataset).

Original model

  • Base: VeriLoop Coder E1 (Qwen3.6-27B)
  • SWE-bench Verified: 85.2% | SWE-bench Pro: 62.4% | Terminal-Bench 2.0: 76.4%

Usage (llama.cpp)

llama-cli -m abl_iq4_nl.gguf -p "def fib(n):" -n 64
# or with a server:
llama-server -m abl_iq4_nl.gguf -c 8192 --port 8080

imatrix.dat can be re-applied with llama-quantize --imatrix imatrix.dat if you want to re-quantize.

License

Apache-2.0 (same as the original).

Run asmanovlev/veriloop-coder-e1-heretic-i1-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models