Phrase judge (2) finished verdicts reach the agent after its next tool call - #470

Open

EdbertChan wants to merge 47 commits into

mainfrom

plan/phrase-judge-2-finished-verdicts-reach-the-agent-after-its-next-tool-call

Commits on Sep 11, 2026

llm-judge: a shared background model judge for hooks

edbert-bot
and
claude
committed
e024cd3
invoker: wf-1789117938963-6/implement-llm-judge-library — Add engine/hooks/llm-judge/judge.py: a runner fallback chain, a detached background job runner, and a per-transcript verdict store with hit…
edbert-bot
committed
5efb763
invoker: wf-1789117938963-6/verify-llm-judge-library — Run the judge library tests and the repo's no-comments gate.
edbert-bot
committed
7be661c
invoker: wf-1789117938963-6/scrub-handoff-artifacts — Terminal read-only check that no inter-task handoff files remain.
edbert-bot
committed
0e6fb2c
Merge experiment/wf-1789117938963-6/scrub-handoff-artifacts/g0.t0.a-a0a4ff72b-46acc04e — Terminal read-only check that no inter-task handoff files remain.
edbert-bot
committed
d90b880
llm-judge: deliver finished verdicts on the agent's next turn

edbert-bot
and
claude
committed
99852d1
invoker: wf-1789118621517-7/implement-llm-judge-inbox — Add the llm-judge inbox hook for Claude, Cursor and Codex, and wire it into install.sh.
edbert-bot
committed
e322f6e
invoker: wf-1789118621517-7/verify-llm-judge-inbox — Run the inbox tests, the hook coverage gate, and the install tests.
edbert-bot
committed
ece2f67
invoker: wf-1789118621517-7/scrub-handoff-artifacts — Terminal read-only check that no inter-task handoff files remain.
edbert-bot
committed
84a9065
Merge experiment/wf-1789118621517-7/scrub-handoff-artifacts/g0.t0.a-adbabd401-e965207c — Terminal read-only check that no inter-task handoff files remain.
edbert-bot
committed
81f2b22
invoker: wf-1789119854592-8/implement-wrong-check-judge — wrong-check-reflect sends a background llm-judge question for each reply that answers a user message, alongside its existing regex path.
edbert-bot
committed
fdc3f18
invoker: wf-1789119854592-8/verify-wrong-check-judge — Run wrong-check-reflect's tests, llm-judge's tests, and the hook coverage gate.
edbert-bot
committed
71ab0d8
invoker: wf-1789119854592-8/scrub-handoff-artifacts — Terminal read-only check that no inter-task handoff files remain.
edbert-bot
committed
a200478
Merge experiment/wf-1789119854592-8/scrub-handoff-artifacts/g0.t0.a-abe7af30b-bd3c4097 — Terminal read-only check that no inter-task handoff files remain.
edbert-bot
committed
78dc644
wrong-check-reflect: drop 7 comment lines the no-comments gate bans

EdbertChan
and
claude
committed
05eb32a
Add llm judge phrase loader
CI Bot
committed
2e0bb00
invoker: wf-1789159008754-1/add-phrase-loader — Review claim: A checker can declare its meaning as a JSON phrase dictionary, and engine/hooks/llm-judge/phrases.py turns that dictionary plus a text …
Invoker Bot
committed
05bc597
docs: add phrase judge skill
CI Bot
committed
a3013d7
invoker: wf-1789159008754-1/document-phrase-judge-skill — Review claim: A phrase-judge skill tells authors to declare a checker's meaning as a phrase dictionary and to grow it with real misses inst…
Invoker Bot
committed
081809e
invoker: wf-1789159008754-1/verify-phrase-loader-tests — Review claim: The llm-judge unit tests, including the new phrase tests, pass.
Invoker Bot
committed
cbf3b6b
invoker: wf-1789159008754-1/verify-phrase-module-dormant — Review claim: No hook outside engine/hooks/llm-judge/ refers to the phrase module, so the change is dormant.
Invoker Bot
committed
b53b5d3
invoker: wf-1789159008754-1/verify-phrase-skill-checks — Review claim: The phrase-judge skill test and the three-harness skill check pass.
Invoker Bot
committed
00bc2c1
Invoker: merge experiment/wf-1789159008754-1/verify-phrase-skill-checks/g0.t0.a-a2da10d77-9902a3ad
CI Bot
committed
4e78d32
Invoker: merge experiment/wf-1789159008754-1/verify-phrase-module-dormant/g0.t0.a-a3c533ce6-fa1d2622
CI Bot
committed
2dbd843
invoker: wf-1789159008754-1/scrub-handoff-artifacts — Review claim: No ephemeral inter-task handoff files remain in the worktree before the merge gate.
Invoker Bot
committed
2a072f8
Merge experiment/wf-1789159008754-1/scrub-handoff-artifacts/g0.t0.a-af1afd028-112f90c9 — Review claim: No ephemeral inter-task handoff files remain in the worktree before the merge gate.
EdbertChan
committed
37bb35c
llm-judge phrases: ask the judge to match meaning in any wording

EdbertChan
and
claude
committed
3008239
test_install: expect phrase-judge in the engine-only skill set

EdbertChan
and
claude
committed
4274083
Merge origin/main into phrase judge (1) after #425's squash merge

EdbertChan
and
claude
committed
9f63b22

Commits on Sep 12, 2026