Add task-bench, which has Haiku fix planted bugs at a base and a head and prints what each side took #683

Merged
lilleman merged 11 commits from item-501 into main 2026-11-21 03:46:52 +01:00

11 Commits

Author SHA1 Message Date
lilleman d813fdad5a Finish item 501 in the plan
CI / tests (pull_request) Successful in 6m11s
2026-11-21 03:40:18 +01:00
lilleman 68152c5dec Merge remote-tracking branch 'origin/main' into item-501
CI / tests (pull_request) Has been cancelled
2026-11-21 03:37:59 +01:00
lilleman 1500c52d69 Answer stability round 2: 0 🔴, 0 🟡 (0 misread); take a failed subtest's message over what its parent logged 2026-11-21 03:37:59 +01:00
lilleman 0c17559efe Test a line printed before any test's mark
CI / tests (pull_request) Successful in 3m51s
2026-11-21 03:09:34 +01:00
lilleman 488f1fd698 Answer prose round 1: 0 🔴, 14 🟡 (0 misread); reword the help, docstrings and README entries in the commit above
CI / tests (pull_request) Successful in 3m57s
2026-11-21 02:41:37 +01:00
lilleman 76131e1ee6 Answer product-owner round 1: 0 🔴, 1 🟡 (0 misread); keep the finished runs and say Bug, the host's gremlins and the reads' median in the commit above 2026-11-21 02:41:36 +01:00
lilleman 8c1edf552a Answer stability round 1: 0 🔴, 10 🟡 (0 misread); take the failed test's last message, fail on a docker run that never started, keep testdata as planted, show finished runs when the API refuses one, and test five survivors 2026-11-21 02:41:36 +01:00
lilleman 1e96a397af Test the value after an equals sign, -h, a line next to a change and the proxy's refusals
CI / tests (pull_request) Successful in 3m54s
2026-11-21 02:04:37 +01:00
lilleman ebbe926ab7 Test task-bench's docker calls, command line and planter where mutants survived
CI / tests (pull_request) Successful in 4m38s
2026-11-21 01:39:12 +01:00
lilleman fed84cc510 Answer security round 1: 0 🔴, 0 🟡 (0 misread); nothing to change 2026-11-21 01:07:18 +01:00
lilleman 089e9b683b Add task-bench, which has Haiku fix planted bugs at a base and a head and prints what each side took
CI / tests (pull_request) Failing after 4m9s
2026-11-21 01:05:50 +01:00