This website requires JavaScript.
Explore
Help
Sign In
lilleman
/
claude-config
Watch
1
Star
0
Fork
0
You've already forked claude-config
Code
Pull Requests
3
Actions
1
Activity
Files
ad11c72016587a7807fcab5914da6bc25b3acede
claude-config
/
bin
/
task_bench
T
History
lilleman
ad11c72016
CI / tests (pull_request)
Failing after 4m49s
Details
Distil each task-bench run into a digest and gather plan items from it
2026-11-21 03:56:18 +01:00
..
__init__.py
Add task-bench, which has Haiku fix planted bugs at a base and a head and prints what each side took
2026-11-21 01:05:50 +01:00
api_proxy.py
Answer stability round 1: 0
🔴
, 10
🟡
(0 misread); take the failed test's last message, fail on a docker run that never started, keep testdata as planted, show finished runs when the API refuses one, and test five survivors
2026-11-21 02:41:36 +01:00
bench_folder.py
Distil each task-bench run into a digest and gather plan items from it
2026-11-21 03:56:18 +01:00
digest.py
Distil each task-bench run into a digest and gather plan items from it
2026-11-21 03:56:18 +01:00
figures.py
Answer stability round 1: 0
🔴
, 10
🟡
(0 misread); take the failed test's last message, fail on a docker run that never started, keep testdata as planted, show finished runs when the API refuses one, and test five survivors
2026-11-21 02:41:36 +01:00
gather-prompt.md
Distil each task-bench run into a digest and gather plan items from it
2026-11-21 03:56:18 +01:00
gather.py
Distil each task-bench run into a digest and gather plan items from it
2026-11-21 03:56:18 +01:00
main.py
Distil each task-bench run into a digest and gather plan items from it
2026-11-21 03:56:18 +01:00
plant.py
Answer stability round 2: 0
🔴
, 0
🟡
(0 misread); take a failed subtest's message over what its parent logged
2026-11-21 03:37:59 +01:00
runs.py
Answer stability round 1: 0
🔴
, 10
🟡
(0 misread); take the failed test's last message, fail on a docker run that never started, keep testdata as planted, show finished runs when the API refuses one, and test five survivors
2026-11-21 02:41:36 +01:00
test_digest.py
Distil each task-bench run into a digest and gather plan items from it
2026-11-21 03:56:18 +01:00
test_figures.py
Answer stability round 1: 0
🔴
, 10
🟡
(0 misread); take the failed test's last message, fail on a docker run that never started, keep testdata as planted, show finished runs when the API refuses one, and test five survivors
2026-11-21 02:41:36 +01:00
test_gather.py
Distil each task-bench run into a digest and gather plan items from it
2026-11-21 03:56:18 +01:00
test_plant.py
Answer stability round 2: 0
🔴
, 0
🟡
(0 misread); take a failed subtest's message over what its parent logged
2026-11-21 03:37:59 +01:00
test_task_bench.py
Distil each task-bench run into a digest and gather plan items from it
2026-11-21 03:56:18 +01:00