AltronisSG/judgment-qc-gate-qwen3-4b-GGUF overview
Judgment QC gate: v10, Q8 0 GGUF Ready to serve quantisation of a 4B LoRA fine tune that reviews work against one operator's standards and returns a single lin…
Runs locally from ~3.99 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| judgment-qwen3-4b-Q8_0.gguf | GGUF | Q8_0 | 3.99 GB | Download |
Model Details
| Model ID | AltronisSG/judgment-qc-gate-qwen3-4b-GGUF |
|---|---|
| Author | AltronisSG |
| Pipeline | — |
| License | apache-2.0 |
| Base model | Qwen/Qwen3-4B |
| Last modified | 2026-08-08T01:41:18.000Z |
Model README
---
license: apache-2.0
base_model: Qwen/Qwen3-4B
tags:
- gguf
- llama-cpp
- judgment
- qc-gate
- agent-safety
---
Judgment QC gate: v10, Q8_0 GGUF
Ready-to-serve quantisation of a 4B LoRA fine-tune that reviews work against one operator's standards
and returns a single-line verdict. Built to run as a Stop-hook gate on a live coding agent: a violation
verdict blocks the agent's reply and is fed back so it fixes the problem or explains why the verdict
does not apply.
These weights are byte-identical to the model running in production on the author's machine.
- File:
judgment-qwen3-4b-Q8_0.gguf(4.3 GB) - Base:
Qwen/Qwen3-4B - Adapter, corpus, evaluation, and limitations: see the companion LoRA repo, read it before
deploying this, particularly the Limitations section
Serve
llama-server -m judgment-qwen3-4b-Q8_0.gguf \
--host 127.0.0.1 --port 8005 \
--ctx-size 4096 --parallel 1 -ngl 99 -fa 1 \
--jinja --reasoning-budget 0 --no-warmup
--reasoning-budget 0 matters: the fine-tune emits an empty <think></think> block before its verdict
(the corpus contains no reasoning traces). Disable thinking, or strip the block in post-processing.
Output contract
VERDICT: OK
VERDICT: <TAG> | <one-sentence correction>
VERDICT: ABSTAIN | <what is missing>
<TAG> comes from a closed vocabulary of about 14: VERIFY, NO-OVERCLAIM, HOLD-LINE, SCOPE, SIMPLE,
DESIGN, SAFETY, ROOT-CAUSE, NO-SILENT-FAIL, MAINTAIN, CURRENT, PROACTIVE, CONCERN-MAP,
FULL-BUILD.
Prefix each situation with its phase, pre (plan / approach), during (execution), or post (before
it ships / claiming done):
[phase: post] Assistant cited a CVE number as the relevant vulnerability without
having looked it up anywhere.
VERDICT: VERIFY | You can't cite a CVE without checking it against the real source.
Measured behaviour
Measured against this exact file while it was serving live, using two fixed probe sets:
| Check | v10 | v8 | v5 |
|---|---|---|---|
| Known violations caught (n=12) | 12 / 12 | 12 / 12 | 12 / 12 |
| False positives on clean situations (n=30) | 0 / 30 | 2 to 3 / 30 | 3 / 30 |
The false-positive count falling to 0/30 tracks the corpus rebalancing: the training set is now about
60 percent compliant-but-risky-looking work, so the model stopped blocking clean situations while still
catching every planted violation.
Two honest caveats. Recall is at ceiling on this probe set, which means the probe set is too easy;
treat 12/12 as "no obvious misses", not "catches everything". And 30 clean cases is a small set, so
read 0/30 as a direction, not a guarantee.
Wiring it as a gate
Treat VERDICT: OK as pass and anything else as a correction to act on. Fail open, loudly. If the
gate is unreachable, let the work through and say the gate was down. A quality gate that silently
blocks is worse than no gate.
Attribution
Built by Altronis. The corpus is one operator's own review history, approved example by example, and
generalised to contain no names, figures, or private details.
Run AltronisSG/judgment-qc-gate-qwen3-4b-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models