GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

AltronisSG/judgment-qc-gate-qwen3-4b-GGUF overview

Judgment QC gate: v10, Q8 0 GGUF Ready to serve quantisation of a 4B LoRA fine tune that reviews work against one operator's standards and returns a single lin…

ggufllama-cppjudgmentqc-gateagent-safetybase_model:Qwen/Qwen3-4Bbase_model:quantized:Qwen/Qwen3-4Blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~3.99 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
562
Likes
0
Pipeline

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
judgment-qwen3-4b-Q8_0.ggufGGUFQ8_03.99 GBDownload

Model Details

Model IDAltronisSG/judgment-qc-gate-qwen3-4b-GGUF
AuthorAltronisSG
Pipeline
Licenseapache-2.0
Base modelQwen/Qwen3-4B
Last modified2026-08-08T01:41:18.000Z

Model README

---

license: apache-2.0

base_model: Qwen/Qwen3-4B

tags:

  • gguf
  • llama-cpp
  • judgment
  • qc-gate
  • agent-safety

---

Judgment QC gate: v10, Q8_0 GGUF

Ready-to-serve quantisation of a 4B LoRA fine-tune that reviews work against one operator's standards

and returns a single-line verdict. Built to run as a Stop-hook gate on a live coding agent: a violation

verdict blocks the agent's reply and is fed back so it fixes the problem or explains why the verdict

does not apply.

These weights are byte-identical to the model running in production on the author's machine.

  • File: judgment-qwen3-4b-Q8_0.gguf (4.3 GB)
  • Base: Qwen/Qwen3-4B
  • Adapter, corpus, evaluation, and limitations: see the companion LoRA repo, read it before

deploying this, particularly the Limitations section

Serve

llama-server -m judgment-qwen3-4b-Q8_0.gguf \
  --host 127.0.0.1 --port 8005 \
  --ctx-size 4096 --parallel 1 -ngl 99 -fa 1 \
  --jinja --reasoning-budget 0 --no-warmup

--reasoning-budget 0 matters: the fine-tune emits an empty <think></think> block before its verdict

(the corpus contains no reasoning traces). Disable thinking, or strip the block in post-processing.

Output contract

VERDICT: OK
VERDICT: <TAG> | <one-sentence correction>
VERDICT: ABSTAIN | <what is missing>

<TAG> comes from a closed vocabulary of about 14: VERIFY, NO-OVERCLAIM, HOLD-LINE, SCOPE, SIMPLE,

DESIGN, SAFETY, ROOT-CAUSE, NO-SILENT-FAIL, MAINTAIN, CURRENT, PROACTIVE, CONCERN-MAP,

FULL-BUILD.

Prefix each situation with its phase, pre (plan / approach), during (execution), or post (before

it ships / claiming done):

[phase: post] Assistant cited a CVE number as the relevant vulnerability without
having looked it up anywhere.
VERDICT: VERIFY | You can't cite a CVE without checking it against the real source.

Measured behaviour

Measured against this exact file while it was serving live, using two fixed probe sets:

| Check | v10 | v8 | v5 |

|---|---|---|---|

| Known violations caught (n=12) | 12 / 12 | 12 / 12 | 12 / 12 |

| False positives on clean situations (n=30) | 0 / 30 | 2 to 3 / 30 | 3 / 30 |

The false-positive count falling to 0/30 tracks the corpus rebalancing: the training set is now about

60 percent compliant-but-risky-looking work, so the model stopped blocking clean situations while still

catching every planted violation.

Two honest caveats. Recall is at ceiling on this probe set, which means the probe set is too easy;

treat 12/12 as "no obvious misses", not "catches everything". And 30 clean cases is a small set, so

read 0/30 as a direction, not a guarantee.

Wiring it as a gate

Treat VERDICT: OK as pass and anything else as a correction to act on. Fail open, loudly. If the

gate is unreachable, let the work through and say the gate was down. A quality gate that silently

blocks is worse than no gate.

Attribution

Built by Altronis. The corpus is one operator's own review history, approved example by example, and

generalised to contain no names, figures, or private details.

Run AltronisSG/judgment-qc-gate-qwen3-4b-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models