Add task-bench, which has Haiku fix planted bugs at a base and a head and prints what each side took #683
Reference in New Issue
Block a user
Delete Branch "item-501"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Adds
task-bench: it plants bugs the tests catch in the Go files the comprehension seats found hardest, has Haiku fix each in a container that reaches only the API, at the base and at the head, and prints how often the fix passes with its median tokens, turns, wall time and reads.