Lilleman
|
a75826d35a
|
Load no MCP server in the bench's headless claude calls that are denied tools
CI / tests (pull_request) Successful in 3m45s
|
2026-11-20 18:02:12 +01:00 |
|
lilleman
|
762614353c
|
Answer principles round 2: 0 🔴, 2 🟡 (0 misread); workflow-bench hands its effects in as arguments, and no Python file of the repo patches a global
CI / tests (pull_request) Successful in 3m46s
|
2026-11-19 12:55:35 +01:00 |
|
lilleman
|
6817b074bd
|
Answer stability round 1: 0 🔴, 6 🟡 (0 misread); the bench tests only the packages the clone holds, refuses a run that ended in an error, and pins a worker's committed change
|
2026-11-12 05:30:15 +01:00 |
|
lilleman
|
e1e99645be
|
Pin the advisor bench's argv, kwargs, diff exclusions and failures in its tests
|
2026-11-12 05:20:39 +01:00 |
|
lilleman
|
45fd66d3ab
|
Test the advisor bench's run, grade, main and rows_of against a throwaway repo, and kill the mutants of its pure functions
|
2026-11-12 05:18:44 +01:00 |
|
lilleman
|
66b9651d68
|
Bench the advisor tool on six archived L 1 and L 2 chunks: Sonnet alone passes as often as Opus at medium for less, so workers stay without it
CI / tests (pull_request) Successful in 2m18s
|
2026-11-12 04:27:48 +01:00 |
|