3
0
mirror of https://github.com/larvit/adf-codec.git synced 2026-11-20 23:25:43 +01:00

Gather an anonymized corpus of real-world ADF documents with each one's source and licence

This commit is contained in:
2026-11-04 21:50:40 +01:00
committed by Lillem4n
parent dbaa6823aa
commit 59954f93b3
168 changed files with 25247 additions and 45 deletions
+5
View File
@@ -12,6 +12,11 @@ One directory per contract kind:
pins which error.
- `real-payloads/` — `<name>.json`: ADF Atlassian's editor wrote, round-tripped ADF→markdown→ADF
and ADF→HTML→ADF. No expected markdown or HTML.
- `real-world/` — `<name>.json`: anonymized documents from public Jira and Confluence sites,
round-tripped as `real-payloads/` is. `real-world-sources.json` names each one's source, licence
and retrieval date. `corpus-gathering/run.sh <raw folder>` writes both, and the raw folder stays
outside the repo because its documents hold the sites' real text
(`docs/decisions.md` §The real-world corpus holds anonymized documents from sites whose licence it records).
- `commonmark-spec/` — the CommonMark suite run against `commonMarkToAdf` by three checks.
`spec.json` is the suite; `refusals.json` pins each refusing example to its error `code`;
`exceptions.json` pins each known divergence by `check`, `example`, `kind` and the exact