This website requires JavaScript.
Explore
Help
Sign In
lilleman
/
claude-config
Watch
1
Star
0
Fork
0
You've already forked claude-config
Code
Pull Requests
3
Actions
1
Activity
Files
a95dd360c8689528b130deb5b687ac0da8ec68a1
claude-config
/
bin
/
task_bench
T
History
lilleman
a95dd360c8
CI / tests (pull_request)
Successful in 8m13s
Details
Merge remote-tracking branch 'origin/main' into item-514
2026-11-22 17:32:09 +01:00
..
__init__.py
Add task-bench, which has Haiku fix planted bugs at a base and a head and prints what each side took
2026-11-21 01:05:50 +01:00
api_proxy.py
Answer stability round 1: 0
🔴
, 10
🟡
(0 misread); take the failed test's last message, fail on a docker run that never started, keep testdata as planted, show finished runs when the API refuses one, and test five survivors
2026-11-21 02:41:36 +01:00
bench_folder.py
Answer stability round 1: 0
🔴
, 5
🟡
(1 misread); keep locks out of compress-archives, count only a search's hits, show an unfinished failing run, and test the walk and the home
2026-11-21 12:18:40 +01:00
digest.py
Answer stability round 1: 0
🔴
, 5
🟡
(1 misread); keep locks out of compress-archives, count only a search's hits, show an unfinished failing run, and test the walk and the home
2026-11-21 12:18:40 +01:00
figures.py
Merge remote-tracking branch 'origin/main' into item-514
2026-11-22 17:32:09 +01:00
gather-prompt.md
Answer stability round 1: 0
🔴
, 5
🟡
(1 misread); keep locks out of compress-archives, count only a search's hits, show an unfinished failing run, and test the walk and the home
2026-11-21 12:18:40 +01:00
gather.py
Answer stability round 1: 0
🔴
, 5
🟡
(1 misread); keep locks out of compress-archives, count only a search's hits, show an unfinished failing run, and test the walk and the home
2026-11-21 12:18:40 +01:00
main.py
Answer product-owner round 1: 0
🔴
, 0
🟡
(0 misread); the help calls the noise figures an All change, and the changelog says the row's meaning changed
2026-11-22 17:32:04 +01:00
plant.py
Answer stability round 2: 0
🔴
, 0
🟡
(0 misread); take a failed subtest's message over what its parent logged
2026-11-21 03:37:59 +01:00
runs.py
Answer stability round 1: 0
🔴
, 10
🟡
(0 misread); take the failed test's last message, fail on a docker run that never started, keep testdata as planted, show finished runs when the API refuses one, and test five survivors
2026-11-21 02:41:36 +01:00
test_digest.py
Answer stability round 1: 0
🔴
, 5
🟡
(1 misread); keep locks out of compress-archives, count only a search's hits, show an unfinished failing run, and test the walk and the home
2026-11-21 12:18:40 +01:00
test_figures.py
Merge remote-tracking branch 'origin/main' into item-514
2026-11-22 17:32:09 +01:00
test_gather.py
Answer stability round 2: 0
🔴
, 0
🟡
(0 misread); test that a gather before any review makes the review folders private; the digest's errors="replace" stays untested, as it takes a lone surrogate in a stream
2026-11-21 12:22:46 +01:00
test_plant.py
Answer stability round 2: 0
🔴
, 0
🟡
(0 misread); take a failed subtest's message over what its parent logged
2026-11-21 03:37:59 +01:00
test_task_bench.py
Answer stability round 1: 0
🔴
, 5
🟡
(1 misread); keep locks out of compress-archives, count only a search's hits, show an unfinished failing run, and test the walk and the home
2026-11-21 12:18:40 +01:00