Commit Graph

8 Commits

Author SHA1 Message Date
lilleman a95dd360c8 Merge remote-tracking branch 'origin/main' into item-514
CI / tests (pull_request) Successful in 8m13s
2026-11-22 17:32:09 +01:00
lilleman f5a691ff07 Answer stability round 1: 0 🔴, 2 🟡 (0 misread); count the passes from the bugs' runs and drop change's duplicate parameters 2026-11-22 17:32:04 +01:00
lilleman f9f96f69ae Build each column's mean change without a no-bugs branch
CI / tests (pull_request) Successful in 5m25s
2026-11-22 17:10:03 +01:00
lilleman e38b6c344b Print the mean of the bugs' own changes as task-bench's All change
CI / tests (pull_request) Successful in 4m28s
2026-11-22 16:52:54 +01:00
lilleman 993295b486 Stop the bench with a Failure on a run that ended on an api_error without a status
CI / tests (pull_request) Successful in 5m21s
2026-11-22 16:50:51 +01:00
lilleman 8c1edf552a Answer stability round 1: 0 🔴, 10 🟡 (0 misread); take the failed test's last message, fail on a docker run that never started, keep testdata as planted, show finished runs when the API refuses one, and test five survivors 2026-11-21 02:41:36 +01:00
lilleman ebbe926ab7 Test task-bench's docker calls, command line and planter where mutants survived
CI / tests (pull_request) Successful in 4m38s
2026-11-21 01:39:12 +01:00
lilleman 089e9b683b Add task-bench, which has Haiku fix planted bugs at a base and a head and prints what each side took
CI / tests (pull_request) Failing after 4m9s
2026-11-21 01:05:50 +01:00