Bench a model step's handoff, and keep resuming the session #575

Merged
lilleman merged 12 commits from item-319 into main 2026-11-17 04:06:55 +01:00
Owner

Item 319 asked for a fresh session with a brief when a rung step changes the worker's model, benched first. workflow-bench/handoff_bench.py benched resume, resume after /compact, and a fresh session with a brief on five L 3 items: resume's verdict matched or beat the brief's on every item, at a lower mean cost. So loop-claude is unchanged, and the routing decision records the bench and its limits.

Item 319 asked for a fresh session with a brief when a rung step changes the worker's model, benched first. `workflow-bench/handoff_bench.py` benched resume, resume after `/compact`, and a fresh session with a brief on five L 3 items: resume's verdict matched or beat the brief's on every item, at a lower mean cost. So loop-claude is unchanged, and the routing decision records the bench and its limits.
lilleman added 4 commits 2026-11-17 03:45:11 +01:00
lilleman added 3 commits 2026-11-17 03:45:12 +01:00
lilleman marked the pull request as ready for review 2026-11-17 04:03:18 +01:00
lilleman added 8 commits 2026-11-17 04:03:19 +01:00
lilleman merged commit 242be1db34 into main 2026-11-17 04:06:55 +01:00
lilleman deleted branch item-319 2026-11-17 04:06:55 +01:00
Sign in to join this conversation.
No Reviewers
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: lilleman/claude-config#575