Drop item 313
CI / tests (pull_request) Successful in 2m34s

This commit was merged in pull request #492.
This commit is contained in:
2026-11-11 23:23:30 +01:00
parent 4d132e9a3c
commit 2ca4d0f8db
2 changed files with 1 additions and 10 deletions
+1 -1
View File
@@ -362,7 +362,7 @@ Valid while the worker's run on a commit finds what a reviewer's run on it would
## review: agents of one type launch in one message, not one a message before the others
2026-11-11, claude, in the stability review of the chunk that took todo item 313, which stays in the plan as a question for lilleman. Serves goals 1.4 and 1.5. Anthropic's prompt caching docs say a cache entry is readable only once the first response that wrote it has started, and item 313 measured 748 comprehension seats, 153 security passes and 130 general-purpose subagents that each wrote their own prefix, $99 from 2026-09-30 to 2026-11-11. Launching one agent of a type before the rest, to read its cache, doesn't pay: a foreground Agent call returns only when its agent has finished, and larv-review runs reviewers in the foreground, so each later launch group would wait one agent's whole run, a seat's median 1.6 minutes, to save a prefix of about 14k tokens. The stability reviewer also found, in the transcripts of 73 seats started within 90 seconds of an earlier seat, that each already read the shared prefix.
2026-11-11, claude, in the stability review of the chunk that took the plan item proposing it; lilleman dropped that item the same day. Serves goals 1.4 and 1.5. Anthropic's prompt caching docs say a cache entry is readable only once the first response that wrote it has started, and the item measured 748 comprehension seats, 153 security passes and 130 general-purpose subagents that each wrote their own prefix, $99 from 2026-09-30 to 2026-11-11. Launching one agent of a type before the rest, to read its cache, doesn't pay: a foreground Agent call returns only when its agent has finished, and larv-review runs reviewers in the foreground, so each later launch group would wait one agent's whole run, a seat's median 1.6 minutes, to save a prefix of about 14k tokens. The stability reviewer also found, in the transcripts of 73 seats started within 90 seconds of an earlier seat, that each already read the shared prefix.
Valid while a foreground Agent call returns only when its agent has finished.
-9
View File
@@ -12,7 +12,6 @@
| ID | Release | Blocked by | Exempt | Item | L | E | I | R | S | Moves | Score |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 313 | 0.8.0 | | question | **Launch the first agent of each type in a parallel wave one message before the others of that type, so they read its prompt cache.** | 1 | 2 | 2 | 3 | 2 | 1.4 by 2 | 0.9 |
| 292 | 0.8.0 | | owner | **Rebuild the routing ladder for Fable 5.2, placing each of its efforts by the Artificial Analysis Intelligence Index beside Opus 5.5's and Sonnet 5.5's, and replace Fable 5.1 wherever it is named.** | 3 | 2 | 3 | 6 | 4 | 1.1 by 4, 1.4 by 3 | 2.4 |
| 320 | 0.8.0 | | | **Bench a worker below the project's rung with the advisor tool against the same worker alone and the project's rung, and file the switch if it wins.** | 2 | 2 | 2 | 4 | 3 | 1.4 by 3, 1.1 by 2 | 2.0 |
| 315 | 0.8.0 | | | **Start each reviewer under `agents/` without `CLAUDE.md`, and hand it the vocabulary, the prose rules and the project's decision titles.** | 3 | 2 | 3 | 6 | 4 | 1.4 by 6 | 2.0 |
@@ -74,14 +73,6 @@
## Details
### 313. Launch the first agent of each type in a parallel wave one message before the others of that type, so they read its prompt cache.
A cache entry is readable only once the first response that wrote it has started ("If you need cache hits for parallel requests, wait for the first response before sending subsequent requests", Anthropic's prompt caching docs). Between 2026-09-30 and 2026-11-11, 748 comprehension seats started within 90 seconds of another seat in the same chunk and each still wrote its own prefix, $73; so did 153 security passes ($17) and 130 general-purpose subagents ($9). Different agent types share no prefix, so only agents of one type gain.
Change `skills/comprehension-panel/SKILL.md` → "Parallel" and `skills/larv-review/SKILL.md` → "Waves": launch one agent of a type, and the others of that type in the next message. Quality doesn't change, since every agent gets the same prompt and model; the cost is one extra worker turn, about $0.02, and a few seconds. Check: the first-turn `cache_read_input_tokens` of seats two to four in the next scoring run.
Question for lilleman, from the stability review of the chunk that took this item (recommendation: drop it): a foreground Agent call returns only when its agent has finished, and larv-review runs reviewers in the foreground, so launching one agent of a type a message before the rest makes each later launch group wait one agent's whole run, a seat's median 1.6 minutes, to save a prefix about 14k tokens long. The review found in the transcripts of 73 seats that each already read the shared prefix. `docs/decisions.md` → `review: agents of one type launch in one message, not one a message before the others` holds the evidence. Launching the first agent in the background would avoid the wait, but larv-review forbids a background reviewer, since a headless run ends with its turn.
### 292. Rebuild the routing ladder for Fable 5.2, placing each of its efforts by the Artificial Analysis Intelligence Index beside Opus 5.5's and Sonnet 5.5's, and replace Fable 5.1 wherever it is named.
Fable 5.2 (`claude-fable-5-2`) has been released. The ladder in `bin/model_routing/ladder.py` tops out at `Rung("claude-fable-5-1", "max")`, and the decision `routing: one ladder of (model, effort) rungs` holds "while no newer model joins the catalog", so it is due for a rebuild.