Record the decision to run comprehension seats without CLAUDE.md
CI / tests (pull_request) Successful in 4m53s

This commit is contained in:
2026-11-17 09:45:45 +01:00
parent cdff7a234e
commit bb8516380e
+8
View File
@@ -704,6 +704,14 @@ Every replayed pass passes the second gate. The unchanged replays alone missed u
Valid while Claude Code honours `omitClaudeMd` for a subagent and passes `agent_type` to a `SubagentStart` hook.
## agents/: a comprehension seat runs as the `comprehension-seat` agent, which starts without `CLAUDE.md`, where its scores on one head held within the spread two runs of the older seats show
2026-11-17, lilleman through todo item 316 (approved 2026-11-11), implemented by claude. Serves goal 1.4, and applies project principle 1. Seats ran as general-purpose subagents, which start with the skill and agent listings, about 7,500 tokens, and `CLAUDE.md`: about 1.3% of spend over the archive measured from 2026-09-30 to 2026-11-12. `agents/comprehension-seat.md` has Read, Grep, Glob and Bash and `omitClaudeMd: true`. A seat reads the project as a newcomer does, and `larv-review prepare-scoring` still writes its prompt from `seat-prompts.md`; the prompt's paragraph listing the files the harness pre-loads is gone, with the `--preloaded` flag that filled it, since the agent pre-loads none. rule-hook holds a seat to the project's rung by its agent type, and still by the opening sentence of its prompt, so a seat launched as another agent is held too.
The measurement, on commit 55235a0 of PR #560, whose two recorded runs of the older seats gave means of Navigation 7.13 and 7.38, Locality 6.13 and 6.13, Shape 6.50 and 6.50, Self-sufficiency 6.13 and 6.50, and overall 6.50 and 6.50. The four seats ran headless on Opus at medium effort, with `CLAUDE_CODE_DISABLE_CLAUDE_MDS=1`, the way `review-replay --omit-claude-md` starts a reviewer without the instruction files; the agent itself could not launch in the session that built it. Two runs without `CLAUDE.md` gave means of Navigation 7.00 and 7.00, Locality 5.75 and 5.88, Shape 6.00 and 6.13, Self-sufficiency 5.88 and 6.00, and overall 6.13 and 6.25: within 0.13 of each other on every dimension, inside the spread of the recorded pairs, at most 0.5 on a dimension and 0.25 overall. A control run with `CLAUDE.md` loaded gave 6.75, 5.63, 6.13, 5.75 and 6.00, so leaving `CLAUDE.md` out moved no mean by more than 0.25, and left none of either run more than 0.13 below the control's. All three headless runs read about 0.4 below the recorded pair, so the first scoring run with the agent may read lower than the history before it; read that as the method's offset, not a change in the project, and rerun this check if a later run reads lower still.
Valid while Claude Code honours `omitClaudeMd` for a subagent.
## rules/: `CLAUDE.md` holds the worker's rules that no file path can scope, and each topic's rules for the worker live in a `rules/` file that Claude Code loads by its `paths:` frontmatter
2026-10-13, lilleman through todo item 95, implemented by claude. Serves goals 1.3 and 1.4. Every session loaded `CLAUDE.md` whole, about 4,200 words. Anthropic's memory docs (code.claude.com/docs/en/memory) say a longer file "reduce[s] adherence", and IFScale (arxiv.org/abs/2507.11538) measures adherence falling as the instruction count grows. A rule goes in `CLAUDE.md` when no file path marks the moment it is needed: the working loop, prose that chat follows, commits, and API spec text, which may sit in code. Every other topic gets a file under `rules/` whose `paths:` name the files that topic is about.