Replay the archived judge verdicts offline through code rules and a classifier trained on the archive #585

Merged
lilleman merged 12 commits from item-299 into main 2026-11-18 14:19:41 +01:00

12 Commits

Author SHA1 Message Date
lilleman 4729412f8a Finish item 299 in the plan
CI / tests (pull_request) Successful in 3m57s
2026-11-18 14:11:33 +01:00
lilleman 0910ff430a Merge remote-tracking branch origin/main into item-299
CI / tests (pull_request) Successful in 3m59s
2026-11-18 14:09:25 +01:00
lilleman 6fd28775b6 Merge remote-tracking branch 'origin/main' into item-299
# Conflicts:
#	docs/reading-cost.md
#	todo.md
2026-11-18 12:27:57 +01:00
lilleman 9845ff3851 Answer stability round 2: 0 🔴, 1 🟡 (0 misread); record the classifier's pass on the 1,116 verdicts beside its fail on the first 1,104, and file the question of its miss rate 2026-11-18 12:27:34 +01:00
lilleman 5b6c2a9519 Answer stability round 1: 1 🔴, 3 🟡 (0 misread); sort the imports, average the classifier over five shuffles and count its pass on both tests, pin the regression and its bound, drop the dead default, keep one report folder 2026-11-18 11:46:22 +01:00
lilleman 01d2788134 Make the regression's shuffle seed an argument with no default 2026-11-18 11:46:15 +01:00
lilleman 76b6e029b9 Average the offline classifier over five shuffles, count a pass only on both tests, and fix the import order 2026-11-18 11:31:43 +01:00
lilleman 02288f955b Test the final message's joined texts and the classifier's word pairs 2026-11-18 10:43:22 +01:00
lilleman dff9051d8c Kill the surviving mutants of the offline replay's report, skipped verdicts and classifier bounds 2026-11-18 10:33:34 +01:00
lilleman e4b3d56b70 Answer product-owner round 1: 0 🔴, 1 🟡 (0 misread); the report names a rule's run the whole archive, in the prose round's commit 2026-11-17 10:22:54 +01:00
lilleman 5f098aa315 Answer prose round 1: 0 🔴, 16 🟡 (0 misread); name the offline deciders and runs, and fix the help, the decision and the docstrings 2026-11-17 10:22:54 +01:00
lilleman 155a65117c Replay the archived judge verdicts offline through code rules and a classifier trained on the archive
CI / tests (pull_request) Failing after 5m8s
2026-11-17 09:37:40 +01:00