larvit/adf-codec
3
0
Fork 0
mirror of https://github.com/larvit/adf-codec.git synced 2026-11-12 11:48:29 +01:00
Code Activity

State the fetch's cost as measured

Browse Source
This commit is contained in:
Lilleman auf Larv
2026-11-04 21:53:41 +01:00
committed by Lillem4n
parent 59954f93b3
commit 232e120666
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/decisions.md
+1 -1
View File
@@ -1203,7 +1203,7 @@ A site joins only with a published licence. All six are hosted by the Linux Foun
replaces it in `corpus-gathering/sites.json`.
The tool stops at 20 result pages of 100 per source, one request a second as the sites' robots.txt
asks, and 150 documents of at most 64 KiB. Those numbers keep a run under two hours and the corpus
asks, and 150 documents of at most 64 KiB. Those numbers keep a fetch to minutes and the corpus
near 1 MB. Selection takes new node and mark types first, then the most new features per byte.
22,769 fetched documents hold no `bodiedSyncBlock`, `decisionItem`, `decisionList`,