Corpus 1d1: the CommonMark subset pairs, and the 1d split #6

Merged
lilleman merged 4 commits from corpus-start into main 2026-08-24 12:54:02 +02:00
2 changed files with 7 additions and 6 deletions
Showing only changes of commit 346bdcc27d - Show all commits
+2 -1
View File
@@ -8,7 +8,8 @@ One directory per contract kind:
`combinations/`. `combinations/`.
- `normalization/``<name>.md` + `<name>.json`: markdown input, and the document - `normalization/``<name>.md` + `<name>.json`: markdown input, and the document
`markdownToAdf` must build from it. One-way; the markdown is not canonical. `markdownToAdf` must build from it. One-way; the markdown is not canonical.
- `errors/``<name>.md` + `<name>.error`: markdown input that must not convert. - `errors/``<name>.md`: markdown input that must not convert. A `<name>.error` beside it
pins which error.
- `real-payloads/``<name>.json`: sanitized live ADF, round-tripped ADF→markdown→ADF. No - `real-payloads/``<name>.json`: sanitized live ADF, round-tripped ADF→markdown→ADF. No
expected markdown. expected markdown.
+5 -5
View File
@@ -23,8 +23,8 @@ normalizes to it through the round-trip.
- Blockquotes prefix lines with `> `; a blank line inside a blockquote is a bare `>`. - Blockquotes prefix lines with `> `; a blank line inside a blockquote is a bare `>`.
- ATX headings (`#``######`); setext input normalizes to ATX. - ATX headings (`#``######`); setext input normalizes to ATX.
- Code fences ``` with the node's language as info string, the fence lengthened past any backtick - Code fences ``` with the node's language as info string, the fence lengthened past any backtick
run in the content — the longest run anywhere plus one, counting mid-line runs no closing fence run in the content — the longest run anywhere plus one, at least three, counting mid-line runs
could match; indented-code input normalizes to fences. no closing fence could match; indented-code input normalizes to fences.
- Code spans: a backtick string one longer than the longest backtick run in the text, the text - Code spans: a backtick string one longer than the longest backtick run in the text, the text
padded with one space on each side where it begins or ends with a backtick, or begins and ends padded with one space on each side where it begins or ends with a backtick, or begins and ends
with a space without being all spaces. The content is literal — inline parsing does not see with a space without being all spaces. The content is literal — inline parsing does not see
@@ -38,9 +38,9 @@ normalizes to it through the round-trip.
CommonMark autolink (absolute URI). CommonMark autolink (absolute URI).
- Paragraphs on one line — no soft wrapping; a soft line break in input becomes a single space. - Paragraphs on one line — no soft wrapping; a soft line break in input becomes a single space.
- Entity references in input decode to their characters; output backslash-escapes only where text - Entity references in input decode to their characters; output backslash-escapes only where text
would otherwise parse as syntax: escape the leading delimiter of a construct that would otherwise would otherwise parse as syntax: escape the leading delimiter of a construct that would
open, re-scan from there, and repeat — with the opener literal the closer parses as text, so otherwise open, re-scan from there, and repeat — with the opener literal the closer parses as
`*not emphasis*` is `\*not emphasis*`, one backslash. text, so `*not emphasis*` is `\*not emphasis*`, one backslash.
- Blocks separated by one blank line, no trailing whitespace, single trailing newline; a document - Blocks separated by one blank line, no trailing whitespace, single trailing newline; a document
with no blocks is the empty string. with no blocks is the empty string.