19 Commits

Author SHA1 Message Date
lilleman a95dd360c8 Merge remote-tracking branch 'origin/main' into item-514
CI / tests (pull_request) Successful in 8m13s
2026-11-22 17:32:09 +01:00
lilleman 4612f71592 Answer product-owner round 1: 0 🔴, 0 🟡 (0 misread); the help calls the noise figures an All change, and the changelog says the row's meaning changed 2026-11-22 17:32:04 +01:00
lilleman f5a691ff07 Answer stability round 1: 0 🔴, 2 🟡 (0 misread); count the passes from the bugs' runs and drop change's duplicate parameters 2026-11-22 17:32:04 +01:00
lilleman f9f96f69ae Build each column's mean change without a no-bugs branch
CI / tests (pull_request) Successful in 5m25s
2026-11-22 17:10:03 +01:00
lilleman e38b6c344b Print the mean of the bugs' own changes as task-bench's All change
CI / tests (pull_request) Successful in 4m28s
2026-11-22 16:52:54 +01:00
lilleman 993295b486 Stop the bench with a Failure on a run that ended on an api_error without a status
CI / tests (pull_request) Successful in 5m21s
2026-11-22 16:50:51 +01:00
lilleman 16d9b3a059 Answer prose round 1: 0 🔴, 10 🟡 (0 misread); rewrite the decision conclusions first with corrected figures, and clarify the help's noise paragraph 2026-11-22 16:24:07 +01:00
lilleman 5c3ac81ed7 Calibrate task-bench on fejkdata and record how many tasks and runs a bench takes
CI / tests (pull_request) Failing after 5m1s
2026-11-22 16:16:00 +01:00
lilleman e2fc5dbfb2 Answer stability round 2: 0 🔴, 0 🟡 (0 misread); test that a gather before any review makes the review folders private; the digest's errors="replace" stays untested, as it takes a lone surrogate in a stream
CI / tests (pull_request) Successful in 5m6s
2026-11-21 12:22:46 +01:00
lilleman 101c8a7c3d Answer stability round 1: 0 🔴, 5 🟡 (1 misread); keep locks out of compress-archives, count only a search's hits, show an unfinished failing run, and test the walk and the home 2026-11-21 12:18:40 +01:00
lilleman 27e5014322 Test the median pick by tokens, the name of a silent claude and the environment git runs in
CI / tests (pull_request) Successful in 4m13s
2026-11-21 11:57:43 +01:00
lilleman b474ec2f5a Test the digest's cuts, the median pick and gather's refusals, and drop project_rung's checkout parameter 2026-11-21 04:24:52 +01:00
lilleman ad11c72016 Distil each task-bench run into a digest and gather plan items from it
CI / tests (pull_request) Failing after 4m49s
2026-11-21 03:56:18 +01:00
lilleman 1500c52d69 Answer stability round 2: 0 🔴, 0 🟡 (0 misread); take a failed subtest's message over what its parent logged 2026-11-21 03:37:59 +01:00
lilleman 0c17559efe Test a line printed before any test's mark
CI / tests (pull_request) Successful in 3m51s
2026-11-21 03:09:34 +01:00
lilleman 8c1edf552a Answer stability round 1: 0 🔴, 10 🟡 (0 misread); take the failed test's last message, fail on a docker run that never started, keep testdata as planted, show finished runs when the API refuses one, and test five survivors 2026-11-21 02:41:36 +01:00
lilleman 1e96a397af Test the value after an equals sign, -h, a line next to a change and the proxy's refusals
CI / tests (pull_request) Successful in 3m54s
2026-11-21 02:04:37 +01:00
lilleman ebbe926ab7 Test task-bench's docker calls, command line and planter where mutants survived
CI / tests (pull_request) Successful in 4m38s
2026-11-21 01:39:12 +01:00
lilleman 089e9b683b Add task-bench, which has Haiku fix planted bugs at a base and a head and prints what each side took
CI / tests (pull_request) Failing after 4m9s
2026-11-21 01:05:50 +01:00