Answer prose round 1: 0 🔴, 3 🟡 (0 misread); item 309's detail says once which verdict decides it and when it moved
CI / tests (pull_request) Successful in 4m20s
CI / tests (pull_request) Successful in 4m20s
This commit is contained in:
@@ -336,9 +336,9 @@ Seats cost $1,143 of the $9,154 measured from 2026-09-30 to 2026-11-11 (12.5%),
|
||||
|
||||
Why it should hold quality: the seats are one model with different personas, so their errors are correlated, and a correlated extra seat adds little. `larv-review agreement` showed on 2026-11-11 that Mid A and the inherited architect voted alike in 58 of 75 paired rulings, while their scores moved alike between two runs on one commit in only 1 of 4 pairs: seats agree with each other more than a run agrees with its rerun, so the rerun carries more new information than the third and fourth seat. Nine judges from seven model families carried about two independent votes (arXiv 2605.29800), and ten with error correlation 0.21 carried 3.5 (arXiv 2609.22512).
|
||||
|
||||
Decide once `agreement` has its 10 commits scored twice. Keep four seats on any pass that files a floor item, since its places come from seat reports. Revise the decision `review: the comprehension check records how hard a project is to read…`, which names the four-seat run.
|
||||
Decide once `larv-review agreement` prints `Assumption holds:` or `Assumption fails:`; it needs 10 commits each scored twice before it can. Keep four seats on any pass that files a floor item, since its places come from seat reports. Revise the decision `review: the comprehension check records how hard a project is to read…`, which names the four-seat run.
|
||||
|
||||
lilleman moved it from 0.12.0 to 0.13.0 on 2026-11-17, because `larv-review agreement` had 6 commits scored twice and the decision needs 10; take it once `larv-review agreement` prints a verdict.
|
||||
lilleman moved it from 0.12.0 to 0.13.0 on 2026-11-17, when 6 commits had been scored twice.
|
||||
|
||||
Touches:
|
||||
- `bin/larv_review/seats.py`: `SCORING_SEATS`, `scores`
|
||||
|
||||
Reference in New Issue
Block a user