Skip to content

feat(WO19): exhaustive per-row tests for alalc-hye/zgh/chr (conformance depth) - #281

Merged
ronaldtse merged 1 commit into
mainfrom
wo19-depth-hye-zgh-chr
Nov 14, 2026
Merged

ronaldtse merged 1 commit into
mainfrom
wo19-depth-hye-zgh-chr

Conversation

@ronaldtse

@ronaldtse ronaldtse commented Nov 14, 2026 •

Copy link
Copy Markdown
Contributor

Summary

WO19-depth: the last executable item in the program (WO17 ledger line "hye 134/12, zgh 43/14, chr 85/18 as future work"). The full romanization tables of the three thin ALA-LC maps are transcribed from the locally-held source PDFs into row-source provenance artifacts, and exhaustive per-row embedded tests are generated with scripts/gen-row-tests.mjs, mirroring the alalc-vai demonstration. No map rules changed — the tests pin the maps' tables against the sources; every generated row agrees with the existing rules (0 mismatches, 0 failures).

Per-map counts (transcribed = generated; every generated test passes)

map transcribed/generated skipped (why)
alalc-hye-Armn-Latn-2022 128 (12 → 140 tests) 4 printed alternates un-expressible: Ե/ե Y/y (Note 2, initial-of-name before a vowel) and Յ/յ Ḥ/ḥ (Note 4, word/stem-initial in compounds) — position-dependent; 6 composite numerals ԺԱ․ ԺԲ․ ԻԱ․ ԻԲ․ ԼԱ․ ԼԲ․ — multi-letter values, the map encodes single-letter numeral rules only; 3 ․․․ placeholders — not romanization rows
alalc-zgh-Tfng-Latn-2012 43 (14 → 57 tests) 0 — complete, incl. ⴳⵯ/ⴽⵯ and the tamatart ⵯ
alalc-chr-Cher-Latn-2012 85 (18 → 103 tests) 0 — complete syllabary grid

Armenian exclusions recorded in the artifact note: the punctuation section (pp. 5-6) is instruction prose, not a table — «» and ։ are encoded map rules not row-transcribed here, ՞/՜ require sentence-end repositioning (un-encodable), ՛ has empty output (generator contract); the diacritics page (p. 4) repeats letter-table rows; the Ev row's printed lower-case vernacular cell is և (եվ is not a printed row; the map encodes it additionally); the printed Զ/զ and Ս/ս rows carry a "(see Note 3)" reference marker, transcribed as plain values.

Source pages: armenian.pdf pp. 1-2 (letter table), p. 2 (Note 3 combinations), p. 7 (numerals); tamazight.pdf p. 1 (single-page table — the text layer drops the U+0331 macron-below marks and the ⵕ ⵟ ⴺ value cells; those values are transcribed from the printed page image); cherokee.pdf p. 1 (syllabary grid; codepoints verified against the text layer).

Gates

  • iscrs test-all --maps <branch>/maps: 11,671 passed, 0 failed (hye 140, zgh 57, chr 103)
  • ts parser: the three changed maps parse clean
  • rs golden recapture (iscrs capture --root <branch>/maps): byte-identical on all 12,337 stored rows; +502 rows = these 256 plus pre-existing uncaptured rows (vai 240 from the WO17 demo, the six 3.2.2 escape rows). The golden jsonl lives in interscript-rs, so it is not touched here (same state as after the vai and G6-item-4 landings; a corpus-wide refresh is a release-round activity, cf. rs PR Update README to include directions on how to develop maps #11).

Test plan

  • rs embedded test run green on the branch corpus (counts above)
  • golden recapture: zero deltas on pre-existing rows
  • maps-CI green on this PR: 12/12 checks pass (rs/ts/ruby/py gates, Ruby+TS corpus parse, JSON-IR artifact build, CodeQL)

Transcribe the full romanization tables of the Armenian (2022),
Moroccan Tamazight (2012) and Cherokee (2012) ALA-LC sources into
row-source provenance artifacts and generate exhaustive per-row
embedded tests with scripts/gen-row-tests.mjs, mirroring the
alalc-vai demonstration.

- alalc-hye-Armn-Latn-2022: 128 rows (letter table pp.1-2, Note 3
  soft-sign combinations p.2, letter numerals p.7)
- alalc-zgh-Tfng-Latn-2012: 43 rows (single-page table, incl. the
  labialized digraphs and the tamatart)
- alalc-chr-Cher-Latn-2012: 85 rows (complete syllabary grid)

No map rules changed: every generated row agrees with the existing
rules (0 mismatches). Un-expressible source rows are recorded as
skipped in the artifact notes, not faked.

Gates: rs test-all 11,671 passed / 0 failed (hye 140, zgh 57,
chr 103); ts parse of the three maps clean; rs golden recapture
byte-identical on all 12,337 stored rows, +502 rows (these 256 plus
pre-existing uncaptured vai 240 and the six 3.2.2 escape rows).
@ronaldtse
ronaldtse merged commit f41bb14 into main Nov 14, 2026
12 checks passed
ronaldtse added a commit that referenced this pull request Nov 14, 2026
256 exhaustive per-row tests transcribed from the ALA-LC Armenian,
Tamazight, and Cherokee source tables (maps #281): hye 12->140, zgh
14->57, chr 18->103 embedded tests. Zero findings - all rows agree
with existing map rules; transliteration output unchanged. Provenance
JSONs ship in scripts/row-sources/.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant