Stop the bench with a Failure on a run that ended on an api_error without a status #691

Merged
lilleman merged 4 commits from item-513 into main 2026-11-22 17:17:31 +01:00
Owner

task-bench counts a run whose final result says terminal_reason api_error as a refused run, even where api_error_status is empty.

task-bench counts a run whose final result says terminal_reason api_error as a refused run, even where api_error_status is empty.
lilleman added 1 commit 2026-11-22 16:51:02 +01:00
lilleman added 2 commits 2026-11-22 17:09:25 +01:00
lilleman marked the pull request as ready for review 2026-11-22 17:09:28 +01:00
lilleman added 1 commit 2026-11-22 17:09:37 +01:00
Finish item 513 in the plan
CI / tests (pull_request) Successful in 7m50s
0b6cc71520
lilleman merged commit 0b6cc71520 into main 2026-11-22 17:17:31 +01:00
lilleman deleted branch item-513 2026-11-22 17:17:31 +01:00
Sign in to join this conversation.
No Reviewers
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: lilleman/claude-config#691