From baa3b8ec91b77e9b6eb2ab53b8f4b8523e7cf3b3 Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Mon, 16 Nov 2026 23:13:37 +0800 Subject: [PATCH] =?UTF-8?q?feat:=20/benchmarks=20page=20=E2=80=94=20reprod?= =?UTF-8?q?ucible=20runtime=20benchmarks,=20script-generated?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Deliverable A of WO20 (issue #238): published, reproducible evidence for SOTA 2027. scripts/benchmarks/ — checked-in drivers per runtime plus one orchestrator: - corpus parse, median-of-3, the parity-README methodology (in-process for ruby/ts/py, iscrs parse wall for rs) - golden replay: the RS golden capture (isc-wf0.jsonl, 12,839 rows) through each runtime; rs via native iscrs capture - transliteration throughput on a committed fixed input set (fixtures/input-set.jsonl, every 25th golden row, frozen); rs has no batch CLI, so its throughput derives from the capture leg and is marked as such generate.mjs runs every leg strictly serially and writes src/data/benchmarks.json — numbers are never hand-edited; the page renders only what the script produced. The scripts read the four runtime trees and the map corpus from sibling checkouts (env-overridable INTERSCRIPT_* and RUBY_BIN); the requirement is documented in scripts/benchmarks/README.md and on the page itself. The page keeps the audit-day parity-README table (2026-11-13) frozen as the baseline and tracks current-HEAD above it, with per-tree commit provenance and a machine profile. Generated from fresh origin/main clones: rs 0.3.2 (74b4b8d), ts 5.10.0 (b74cfdaf), ruby 3.7.2 (4c47eb52), py 0.1.0 (5781a996, the unmerged py/ISC branch of interscript-ruby), maps c55bc5c, on an Apple M1 Max / ruby 3.4.8. Findings surfaced by the first run (recorded on the page): py diverges on 3 of 12,839 golden rows (the new Ў rows of gki-bel/mvd-bel/odni-bel); ruby origin/main fails to parse 120/428 corpus maps under ruby 4.0.7 (CI covers 3.3/3.4 — the benchmarks run on 3.4.8, which parses 428/428). --- .prettierignore | 1 + package.json | 5 +- scripts/benchmarks/README.md | 90 ++++ scripts/benchmarks/config.mjs | 156 ++++++ scripts/benchmarks/fixtures/input-set.jsonl | 514 ++++++++++++++++++++ scripts/benchmarks/generate.mjs | 369 ++++++++++++++ scripts/benchmarks/make-fixture.mjs | 33 ++ scripts/benchmarks/parse-py.py | 57 +++ scripts/benchmarks/parse-ruby.rb | 33 ++ scripts/benchmarks/parse-ts.mjs | 34 ++ scripts/benchmarks/replay-py.py | 101 ++++ scripts/benchmarks/replay-ruby.rb | 64 +++ scripts/benchmarks/replay-ts.mjs | 69 +++ src/data/benchmarks.json | 197 ++++++++ src/layouts/Base.astro | 2 + src/pages/benchmarks.astro | 449 +++++++++++++++++ 16 files changed, 2172 insertions(+), 2 deletions(-) create mode 100644 scripts/benchmarks/README.md create mode 100644 scripts/benchmarks/config.mjs create mode 100644 scripts/benchmarks/fixtures/input-set.jsonl create mode 100644 scripts/benchmarks/generate.mjs create mode 100644 scripts/benchmarks/make-fixture.mjs create mode 100644 scripts/benchmarks/parse-py.py create mode 100644 scripts/benchmarks/parse-ruby.rb create mode 100644 scripts/benchmarks/parse-ts.mjs create mode 100644 scripts/benchmarks/replay-py.py create mode 100644 scripts/benchmarks/replay-ruby.rb create mode 100644 scripts/benchmarks/replay-ts.mjs create mode 100644 src/data/benchmarks.json create mode 100644 src/pages/benchmarks.astro diff --git a/.prettierignore b/.prettierignore index 850a4e0..0908bcd 100644 --- a/.prettierignore +++ b/.prettierignore @@ -9,6 +9,7 @@ test-results/ # Generated files (regenerated by scripts — don't fight their formatting) src/data/maps-catalogue.json +src/data/benchmarks.json package-lock.json public/maps/ diff --git a/package.json b/package.json index fb37a90..9738a94 100644 --- a/package.json +++ b/package.json @@ -19,7 +19,8 @@ "test:e2e": "playwright test", "test:e2e:ui": "playwright test --ui", "generate:catalogue": "tsx scripts/generate-catalogue.mjs", - "generate:models": "tsx scripts/generate-models.mjs" + "generate:models": "tsx scripts/generate-models.mjs", + "generate:benchmarks": "node scripts/benchmarks/generate.mjs" }, "dependencies": { "@asciidoctor/core": "^4.0.6", @@ -62,4 +63,4 @@ "typescript-eslint": "^8.70.0", "vitest": "^5.1.0" } -} \ No newline at end of file +} diff --git a/scripts/benchmarks/README.md b/scripts/benchmarks/README.md new file mode 100644 index 0000000..c56f419 --- /dev/null +++ b/scripts/benchmarks/README.md @@ -0,0 +1,90 @@ +# Benchmarks + +Reproducible runtime benchmarks behind the `/benchmarks` page. Every +number on the page comes out of these scripts; the generated data file +(`src/data/benchmarks.json`) is committed but **never hand-edited** — +regenerate it and commit the result. + +## Requirements: sibling checkouts + +The scripts read the four runtime engines and the map corpus from +sibling checkouts in the monorepo layout (`~/src/interscript/` by +default, one directory above this repo). This is a hard requirement — +the engines under test are the actual runtime trees, not npm installs: + +| Tree | Default sibling path | State required | +| ---------------- | ----------------------- | ------------------------------------------------------------------------------------------------------------------------- | +| map corpus | `../maps` | `maps/maps/*.isc` + `maps/libs/*.isc` | +| interscript-rs | `../interscript-rs` | release build: `cargo build --release` | +| interscript-ts | `../interscript-ts` | built dist: `npm ci && npm run build` | +| interscript-ruby | `../interscript-ruby` | lib tree (run with `ruby -I /lib`) | +| py ISC engine | `../interscript-py-isc` | the `wo17/py-override-placement` branch of the interscript-ruby repo (the py package sits at `interscript-py/` inside it) | + +Every location can be overridden with `INTERSCRIPT_MAPS`, +`INTERSCRIPT_RS`, `INTERSCRIPT_TS`, `INTERSCRIPT_RUBY`, and +`INTERSCRIPT_PY` environment variables. The ruby legs use the `ruby` +interpreter by default; override with `RUBY_BIN` when the engine under +test requires a specific toolchain (the interscript-ruby CI matrix +covers 3.3 and 3.4 — run the ruby legs on a covered version; the +machine profile in the generated data records which binary ran). + +> The py ISC engine ships on an unmerged branch of the interscript-ruby +> repo; `interscript-py` main still carries the legacy `.imp` engine and +> cannot run the ISC corpus. The generated data records the exact tree +> and commit for every runtime. + +Note on rs's engine dependency: the rs checkout pins `parsanol` by an +absolute path to a local checkout. If that checkout does not satisfy the +version requirement, point the dependency at the matching crates.io +release (code-identical) and record the deviation when publishing. + +## Methodology + +Follows the parity audit's timing protocol +(`maps/docs/parity/README.md` §A.8): median-of-3 runs, **clean serial +execution** — one runtime at a time, nothing else running on the +machine. In-process timing for ruby/ts/py (`Process.clock_gettime` / +`performance.now()` / `perf_counter` around the sweep), wall clock for +the rs CLI legs (`iscrs parse`, `iscrs capture` — adds ~20 ms process +startup). Replay legs do one unmeasured warmup pass before the measured +passes so lazy compilation settles. + +Legs: + +1. **Corpus parse** — each runtime's native parse entry over every + `maps/maps/*.isc` (py with a dependency resolver over maps+libs, its + bare entry cannot take the corpus alone — parity README G12). +2. **Golden replay** — every row of the RS golden capture + (`interscript-rs/tests/golden/isc-wf0.jsonl`) through each runtime. + rs's number is `iscrs capture` (load + transliterate every corpus + map's embedded tests in one process, includes parse). +3. **Fixed-input throughput** — the committed fixture + (`fixtures/input-set.jsonl`, every 25th golden row, sampled once and + frozen) through each runtime. rs has no batch transliteration CLI, so + its throughput is derived from the capture leg and marked as such. + +## Files + +- `config.mjs` — sibling-path resolution, machine profile, medians +- `parse-ruby.rb` / `parse-ts.mjs` / `parse-py.py` — corpus parse legs +- `replay-ruby.rb` / `replay-ts.mjs` / `replay-py.py` — jsonl replay + legs (golden + fixture via argument) +- `make-fixture.mjs` — regenerate the fixed input set from the golden + capture (run once; the fixture is committed) +- `generate.mjs` — the orchestrator: runs every leg serially, aggregates + medians, writes `src/data/benchmarks.json` +- `fixtures/input-set.jsonl` — the frozen fixed input set + +## Run + +```sh +# one-time (or when deliberately re-freezing the input set): +node scripts/benchmarks/make-fixture.mjs + +# full regeneration (~30-60 min of clean serial runs): +node scripts/benchmarks/generate.mjs +``` + +Then commit `src/data/benchmarks.json` together with the runtime +changes it measures. CI runs `astro check` + build, which fail if the +page references data that does not exist. diff --git a/scripts/benchmarks/config.mjs b/scripts/benchmarks/config.mjs new file mode 100644 index 0000000..1b5d2e1 --- /dev/null +++ b/scripts/benchmarks/config.mjs @@ -0,0 +1,156 @@ +/** + * Shared configuration for the /benchmarks scripts. + * + * All legs read the four runtime engines and the map corpus from + * SIBLING CHECKOUTS of the monorepo layout (see README.md). Paths are + * env-overridable so the scripts stay reproducible on any machine with + * the same layout: + * + * INTERSCRIPT_MAPS maps checkout (maps/maps + maps/libs) + * INTERSCRIPT_RS interscript-rs checkout (release iscrs binary) + * INTERSCRIPT_TS interscript-ts checkout (built dist/) + * INTERSCRIPT_RUBY interscript-ruby checkout + * INTERSCRIPT_PY interscript-py ISC-engine checkout + * (the py/ISC line maintained inside the + * interscript-ruby repo, branch + * wo17/py-override-placement; its Python tree + * sits at /interscript-py) + */ + +import { execFileSync } from "node:child_process" +import { existsSync, readFileSync } from "node:fs" +import os from "node:os" +import { dirname, resolve } from "node:path" +import { fileURLToPath } from "node:url" + +const HERE = dirname(fileURLToPath(import.meta.url)) +export const REPO_ROOT = resolve(HERE, "..", "..") + +const sibling = (envVar, relative) => { + const fromEnv = process.env[envVar] + if (fromEnv) return resolve(fromEnv) + return resolve(REPO_ROOT, "..", relative) +} + +export const SIBLINGS = { + maps: sibling("INTERSCRIPT_MAPS", "maps"), + rs: sibling("INTERSCRIPT_RS", "interscript-rs"), + ts: sibling("INTERSCRIPT_TS", "interscript-ts"), + ruby: sibling("INTERSCRIPT_RUBY", "interscript-ruby"), + py: sibling("INTERSCRIPT_PY", "interscript-py-isc"), +} + +export const MAPS_DIR = (s) => resolve(s ?? SIBLINGS.maps, "maps") +export const LIBS_DIR = (s) => resolve(s ?? SIBLINGS.maps, "libs") +export const GOLDEN_JSONL = () => resolve(SIBLINGS.rs, "tests", "golden", "isc-wf0.jsonl") +export const RS_BINARY = () => resolve(SIBLINGS.rs, "target", "release", "iscrs") +export const TS_DIST = () => resolve(SIBLINGS.ts, "dist") +export const RUBY_LIB = () => resolve(SIBLINGS.ruby, "lib") +export const PY_SRC = () => resolve(SIBLINGS.py, "interscript-py", "src") +export const FIXTURE = resolve(HERE, "fixtures", "input-set.jsonl") +/** + * The ruby binary for the ruby legs. Defaults to `ruby`; override when + * the engine under test requires a specific toolchain (the + * interscript-ruby CI matrix covers 3.3/3.4 — run the legs on a + * covered version; the machine profile records which one ran). + */ +export const RUBY_BIN = process.env.RUBY_BIN ?? "ruby" + +export function requireSiblings() { + const missing = [] + if (!existsSync(MAPS_DIR())) missing.push(`maps corpus: ${MAPS_DIR()}`) + if (!existsSync(RS_BINARY())) + missing.push(`rs release binary (cargo build --release in ${SIBLINGS.rs}): ${RS_BINARY()}`) + if (!existsSync(resolve(TS_DIST(), "isc", "index.js"))) + missing.push(`ts built dist (npm ci && npm run build in ${SIBLINGS.ts})`) + if (!existsSync(RUBY_LIB())) missing.push(`ruby lib: ${RUBY_LIB()}`) + if (!existsSync(PY_SRC())) missing.push(`py ISC src: ${PY_SRC()}`) + if (!existsSync(GOLDEN_JSONL())) missing.push(`golden jsonl: ${GOLDEN_JSONL()}`) + if (missing.length > 0) { + console.error( + "Missing sibling checkouts (set INTERSCRIPT_* env vars to point elsewhere):\n " + + missing.join("\n "), + ) + process.exit(2) + } +} + +/** `git rev-parse HEAD` of a checkout, or null outside a git repo. */ +export function headSha(dir) { + try { + return execFileSync("git", ["-C", dir, "rev-parse", "HEAD"], { + encoding: "utf8", + }).trim() + } catch { + return null + } +} + +function firstFileLine(path, pattern) { + try { + const text = readFileSync(path, "utf8") + for (const line of text.split("\n")) { + const m = line.match(pattern) + if (m) return m[1] + } + return null + } catch { + return null + } +} + +/** Versions carved out of each tree's own metadata (best effort). */ +export function runtimeVersions() { + const tsPkg = (() => { + try { + return JSON.parse(readFileSync(resolve(SIBLINGS.ts, "package.json"), "utf8")) + } catch { + return {} + } + })() + return { + rs: firstFileLine(resolve(SIBLINGS.rs, "Cargo.toml"), /^version = "(.+)"$/), + ts: tsPkg.version ?? null, + ruby: firstFileLine( + resolve(SIBLINGS.ruby, "lib", "interscript", "version.rb"), + /VERSION = "(.+)"$/, + ), + py: firstFileLine( + resolve(SIBLINGS.py, "interscript-py", "pyproject.toml"), + /^version = "(.+)"$/m, + ), + } +} + +export function machineProfile() { + const cpu = os.cpus()[0] + return { + os: `${os.type()} ${os.release()}`, + arch: os.arch(), + cpuModel: cpu?.model ?? "unknown", + cores: os.cpus().length, + memoryGb: Math.round(os.totalmem() / 1024 / 1024 / 1024), + node: process.version, + toolchains: { + ruby: toolchainVersion(RUBY_BIN, ["-v"], /ruby (\S+)/), + python: toolchainVersion("python3", ["--version"], /Python (\S+)/), + }, + } +} + +function toolchainVersion(cmd, args, pattern) { + try { + const out = execFileSync(cmd, args, { encoding: "utf8" }) + const m = out.match(pattern) + return m ? m[1] : out.trim() + } catch { + return null + } +} + +export function median(values) { + const sorted = [...values].sort((a, b) => a - b) + const mid = Math.floor(sorted.length / 2) + const odd = sorted.length % 2 === 1 + return odd ? sorted[mid] : (sorted[mid - 1] + sorted[mid]) / 2 +} diff --git a/scripts/benchmarks/fixtures/input-set.jsonl b/scripts/benchmarks/fixtures/input-set.jsonl new file mode 100644 index 0000000..a625c13 --- /dev/null +++ b/scripts/benchmarks/fixtures/input-set.jsonl @@ -0,0 +1,514 @@ +{"map":"acadsin-zho-Hani-Latn-2002","src":"阜康","out":"Fukang"} +{"map":"alalc-amh-Ethi-Latn-1997","src":"አዲግራት","out":"ʼadigerāte"} +{"map":"alalc-amh-Ethi-Latn-1997","src":"ራስ ጉግሣ ፳፮","out":"rāse gugeśā 206"} +{"map":"alalc-amh-Ethi-Latn-2011","src":"የሚያስፈልጉ ህጎች ጥንቅር ነው። ቋንቋወችን ለመፈረጅ እንዲሁም","out":"yamiyāsefalegu hegoče ṭeneqere nawe። qwāneqwāwačene lamafaraǧe ʼenedihume"} +{"map":"alalc-amh-Ethi-Latn-2011","src":"ኦፓኛ","out":"ʼopāñā"} +{"map":"alalc-ara-Arab-Latn-1997","src":"يَد","out":"yad"} +{"map":"alalc-ara-Arab-Latn-1997","src":"يَحيَى","out":"yaḥyá"} +{"map":"alalc-ara-Arab-Latn-1997","src":"عَدُوّ","out":"‘adūw"} +{"map":"alalc-ara-Arab-Latn-1997","src":"الإتِّحَاد","out":"al-ittiḥād"} +{"map":"alalc-asm-Deva-Latn-1997","src":"লখিমপুৰ জিলাৰ নাৰায়ণপুৰৰ বৰপথাৰত আজি প্ৰশান্তি ধাম নামেৰে এখন বৃদ্ধাশ্ৰমৰ শুভাৰম্ভ কৰা হয়","out":"lakhimapura jilāra nārāẏaṇapurara barapathārata āji praśānti dhāma nāmere ekhana bṛddhāśramara śubhārambha karā haẏa"} +{"map":"alalc-aze-Arab-Latn-1997","src":"اَيْوَان","out":"Eyvān"} +{"map":"alalc-ban-Bali-Latn-2025","src":"ᬒ","out":"au"} +{"map":"alalc-bel-Cyrl-Latn-1997","src":"Парк Чалюскінцаў","out":"Park Chali͡uskintsaŭ"} +{"map":"alalc-bod-Tibt-Latn-2015","src":"ཀ་","out":"ka"} +{"map":"alalc-btk-Batk-Latn-2012","src":"ᯄ","out":"ka"} +{"map":"alalc-chr-Cher-Latn-2012","src":"Ꭱ","out":"e"} +{"map":"alalc-chr-Cher-Latn-2012","src":"Ꮊ","out":"me"} +{"map":"alalc-chr-Cher-Latn-2012","src":"Ꮣ","out":"da"} +{"map":"alalc-chr-Cher-Latn-2012","src":"Ꮼ","out":"wo"} +{"map":"alalc-chu-Cyrl-Latn-2022","src":"Ж","out":"Zh"} +{"map":"alalc-chu-Cyrl-Latn-2022","src":"р","out":"r"} +{"map":"alalc-chu-Cyrl-Latn-2022","src":"Ъ","out":"ʺ"} +{"map":"alalc-chu-Cyrl-Latn-2022","src":"ѫ","out":"ǫ"} +{"map":"alalc-cjm-Cham-Latn-2015","src":"꩗","out":"7"} +{"map":"alalc-div-Thaa-Latn-1997","src":"ބޮއް","out":"boh"} +{"map":"alalc-ell-Grek-Latn-1997","src":"κογξ","out":"konx"} +{"map":"alalc-ell-Grek-Latn-1997","src":"Άμφισσα","out":"Amphissa"} +{"map":"alalc-ell-Grek-Latn-1997","src":"Επτάνησα","out":"Eptanēsa"} +{"map":"alalc-ell-Grek-Latn-1997","src":"Καστοριά","out":"Kastoria"} +{"map":"alalc-ell-Grek-Latn-1997","src":"Λέρος","out":"Leros"} +{"map":"alalc-ell-Grek-Latn-1997","src":"Όλυμπος","out":"Olympos"} +{"map":"alalc-ell-Grek-Latn-1997","src":"Σαντορίνη","out":"Santorinē"} +{"map":"alalc-ell-Grek-Latn-1997","src":"Χαλκιδική","out":"Chalkidikē"} +{"map":"alalc-ell-Grek-Latn-1997","src":"Λευκωσία","out":"Leukōsia"} +{"map":"alalc-ell-Grek-Latn-1997","src":"Ταϊτή","out":"Taitē"} +{"map":"alalc-ell-Grek-Latn-2010","src":"αθεΐα","out":"atheia"} +{"map":"alalc-ell-Grek-Latn-2010","src":"Βόλος","out":"Volos"} +{"map":"alalc-ell-Grek-Latn-2010","src":"Θεσσαλία","out":"Thessalia"} +{"map":"alalc-ell-Grek-Latn-2010","src":"Κοζάνη","out":"Kozanē"} +{"map":"alalc-ell-Grek-Latn-2010","src":"Μαρκόπουλο","out":"Markopoulo"} +{"map":"alalc-ell-Grek-Latn-2010","src":"Πειραιάς","out":"Peiraias"} +{"map":"alalc-ell-Grek-Latn-2010","src":"Στερεά Ελλάδα","out":"Sterea Ellada"} +{"map":"alalc-ell-Grek-Latn-2010","src":"Άμστερνταμ","out":"Amsterntam"} +{"map":"alalc-ell-Grek-Latn-2010","src":"Μόσχα","out":"Moscha"} +{"map":"alalc-ell-Grek-Latn-2010","src":"Χαβάη","out":"Chavaē"} +{"map":"alalc-fas-Arab-Latn-1997","src":"كُلِّيَّة الآدَاب","out":"Kullīyat al-Ādāb"} +{"map":"alalc-guj-Gujr-Latn-2011","src":"ઓગસ્ટ મહિનામાં મેન્યુફેક્ચરિંગ સેક્ટરનું ઉત્પાદન ગગડ્યુ","out":"ȏgasṭa mahināmāṃ mȇnyuphȇkcariṅga sȇkṭaranuṃ utpādana gagaḍyu"} +{"map":"alalc-hin-Deva-Latn-2011","src":"छोटे व्यापारियों को ढूंढें, उनसे खरीदें और उनका साथ दें","out":"choṭe vyāpāriyoṃ ko ḍhūṃḍheṃ, unase kharīdeṃ ăur unakā sāth deṃ"} +{"map":"alalc-hye-Armn-Latn-2022","src":"Ե","out":"E"} +{"map":"alalc-hye-Armn-Latn-2022","src":"ձ","out":"dz"} +{"map":"alalc-hye-Armn-Latn-2022","src":"Վ","out":"V"} +{"map":"alalc-hye-Armn-Latn-2022","src":"գհ","out":"gʹh"} +{"map":"alalc-hye-Armn-Latn-2022","src":"Ձ․","out":"80"} +{"map":"alalc-jav-Arab-Latn-2012","src":"ح","out":"h"} +{"map":"alalc-jav-Arab-Latn-2012","src":"ه","out":"h"} +{"map":"alalc-jav-Arab-Latn-2012","src":"ياڠ","out":"yang"} +{"map":"alalc-jav-Java-Latn-2012","src":"ꦏ꦳","out":"kha"} +{"map":"alalc-jba-Hebr-Latn-2011","src":"ך","out":"k"} +{"map":"alalc-jba-Hebr-Latn-2011","src":"ﭏ","out":"ʼl"} +{"map":"alalc-jba-Hebr-Latn-2011","src":"אייאם","out":"ʼyyʼm"} +{"map":"alalc-jpn-Hrkt-Latn-2022","src":"きぃ","out":"kī"} +{"map":"alalc-jpn-Hrkt-Latn-2022","src":"を","out":"o"} +{"map":"alalc-jpn-Hrkt-Latn-2022","src":"すぇ","out":"swe"} +{"map":"alalc-jpn-Hrkt-Latn-2022","src":"ヴュ","out":"vyu"} +{"map":"alalc-jpn-Hrkt-Latn-2022","src":"しんえつ","out":"shin'etsu"} +{"map":"alalc-kan-Kana-Latn-2011","src":"ಹೇಗಿದೆ ಅಮೆರಿಕನ್‌ ಚುನಾವಣ ಕಣ?","out":"hēgide amerikan cunāvaṇa kaṇa?"} +{"map":"alalc-kat-Geor-Latn-1997","src":"მუხრან-თელეთი","out":"muxran-tʻeletʻi"} +{"map":"alalc-kat-Geor-Latn-2011","src":"მუხრან-თელეთი","out":"muxran-tʻeletʻi"} +{"map":"alalc-kaz-Arab-Latn-2012","src":"ه","out":"e"} +{"map":"alalc-kaz-Arab-Latn-2012","src":"ٴ","out":"ʼ"} +{"map":"alalc-kor-Hang-Latn-1997","src":"은행정","out":"Ŭnhaengjŏng"} +{"map":"alalc-kur-Arab-Latn-2012","src":"ئا","out":"a"} +{"map":"alalc-kur-Arab-Latn-2012","src":"ڵ","out":"ł"} +{"map":"alalc-kur-Arab-Latn-2012","src":"ﻫﻪر","out":"her"} +{"map":"alalc-kur-Arab-Latn-2012","src":"دِوێره","out":"diwêre"} +{"map":"alalc-lad-Hebr-Latn-2025","src":"ח","out":"ḥ"} +{"map":"alalc-lad-Hebr-Latn-2025","src":"ק","out":"ḳ"} +{"map":"alalc-lad-Hebr-Latn-2025","src":"ביל","out":"bel"} +{"map":"alalc-lao-Laoo-Latn-2012","src":"ຫຍ້າ","out":"nyā"} +{"map":"alalc-lep-Lepc-Latn-2012","src":"ᰣᰶ","out":"â"} +{"map":"alalc-mar-Deva-Latn-1997","src":"ठाणे - जिल्ह्यात बुधवारी एक हजार रुग्णांची वाढ, तर जणांच्या मृत्यूची नोंद","out":"ṭhaāṇae - jailahayaāta baudhavaāraī eka hajaāra raugaṇaāñcaī vaāḍha, tara jaṇaāñcayaā maṛitayaūcaī naonda"} +{"map":"alalc-mnc-Mong-Latn-2012","src":"ᠠ","out":"a"} +{"map":"alalc-mnc-Mong-Latn-2012","src":"ᠶ","out":"y"} +{"map":"alalc-mon-Cyrl-Latn-1997","src":"Шарынгол","out":"Sharyngol"} +{"map":"alalc-mon-Cyrl-Latn-1997","src":"Говьсүмбэр Сум","out":"Govisümbêr Sum"} +{"map":"alalc-mon-Cyrl-Latn-1997","src":"Ёроол, оёдол","out":"Ërool, oëdol"} +{"map":"alalc-ori-Orya-Latn-1997","src":"ତିର୍ତ୍ତୋଲର ବିକାଶ ନେଇ ବିଷ୍ଣୁବାବୁ ମୋତେ ବହୁ ବାର ଭେଟୁଥିଲେ: ନବୀନ","out":"tirtteālara bikāśa nei bishṇubābu mote bahu bāra bheṭuthile: nabīna"} +{"map":"alalc-ota-Arab-Latn-1997","src":"س","out":"s"} +{"map":"alalc-ota-Arab-Latn-1997","src":"وَْ","out":"aw"} +{"map":"alalc-pli-Deva-Latn-2012","src":"तेन खो पन समयेन वेसालिया अविदूरे कलन्दगामो नाम अत्थि","out":"taena khao pana samayaena vaesaālaiyaā avaidaūrae kalanadagaāmao naāma atathai"} +{"map":"alalc-pus-Arab-Latn-2013","src":"ر","out":"r"} +{"map":"alalc-pus-Arab-Latn-2013","src":"ة","out":"h"} +{"map":"alalc-rue-Cyrl-Latn-2013","src":"г","out":"h"} +{"map":"alalc-rue-Cyrl-Latn-2013","src":"К","out":"K"} +{"map":"alalc-rue-Cyrl-Latn-2013","src":"х","out":"k͡h"} +{"map":"alalc-rus-Cyrl-Latn-1997","src":"Владимир","out":"Vladimir"} +{"map":"alalc-rus-Cyrl-Latn-1997","src":"Кандалакша","out":"Kandalaksha"} +{"map":"alalc-rus-Cyrl-Latn-1997","src":"Подъездной","out":"Podʺezdnoǐ"} +{"map":"alalc-rus-Cyrl-Latn-2012","src":"Лужники","out":"Luzhniki"} +{"map":"alalc-rus-Cyrl-Latn-2012","src":"Углич","out":"Uglich"} +{"map":"alalc-san-Deva-Latn-2012","src":"पूर्णस्य पूर्णमादाय पूर्णमेवावशिष्यते","out":"pūrṇasya pūrṇamādāya pūrṇamevāvaśiṣyate"} +{"map":"alalc-sin-Sinh-Latn-2011","src":"ඉරණවිල වෙරළේ නාඳුනන ධීවර යාත‍්‍රා දෙකක්","out":"iraṇavila veraḷē nāndunana dhīvara yātarā dekak"} +{"map":"alalc-snd-Arab-Latn-2024","src":"ڏ","out":"d̤"} +{"map":"alalc-snd-Arab-Latn-2024","src":"ن","out":"n"} +{"map":"alalc-srp-Cyrl-Latn-2013","src":"Црна Трава","out":"Crna Trava"} +{"map":"alalc-tam-Taml-Latn-1997","src":"ஸ்கூல் ப்ரெண்ட் கார்த்திக் வீட்டுக்கு போய்ட்டு","out":"skūl preṇṭ kārttik vīṭṭukku pōyṭṭu"} +{"map":"alalc-tel-Telu-Latn-1997","src":"వారిపై జీవితాంతం నిషేధం విధించండి!","out":"vāripai jīvitāntaṃ niṣēdhaṃ vidhiñcaṃḍi!"} +{"map":"alalc-tir-Ethi-Latn-1997","src":"መሠረተ ፅኑ ሰብዕናን ያልሻርን","out":"maśarata ṡenu sabeʻenāne yālešārene"} +{"map":"alalc-tir-Ethi-Latn-1997","src":"ደብረ ታቦር (ከተማ)","out":"dabera tābore (katamā)"} +{"map":"alalc-tir-Ethi-Latn-1997","src":"ዳግማዊ ዓጼ ተክለ ጊዮርጊስ ፫","out":"dāgemāwi ʻāṣé takela giyoregise 3"} +{"map":"alalc-tir-Ethi-Latn-2011","src":"አንኮበር","out":"ʼanekobare"} +{"map":"alalc-tir-Ethi-Latn-2011","src":"ቡሳኛ","out":"busāñā"} +{"map":"alalc-tmh-Tfng-Latn-2013","src":"ⵏⵏ","out":"nn"} +{"map":"alalc-uig-Arab-Latn-2015","src":"چ","out":"ch"} +{"map":"alalc-uig-Arab-Latn-2015","src":"ئۈ","out":"ü"} +{"map":"alalc-ukr-Cyrl-Latn-1997","src":"Іванівщина","out":"Ivanivshchyna"} +{"map":"alalc-und-Dsrt-Latn-2016","src":"𐐰","out":"a"} +{"map":"alalc-und-Dsrt-Latn-2016","src":"𐐕","out":"Ch"} +{"map":"alalc-und-Dsrt-Latn-2016","src":"𐑆","out":"z"} +{"map":"alalc-und-Dsrt-Latn-2016","src":"𐐒𐐮𐐺","out":"Bib"} +{"map":"alalc-urd-Arab-Latn-2013","src":"ف","out":"f"} +{"map":"alalc-urd-Arab-Latn-2013","src":"آب","out":"āb"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꔋ","out":"gbe"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꔨ","out":"wi"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꕅ","out":"gi"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꕠ","out":"ɗa"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꕻ","out":"mgbo"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꖘ","out":"hũ"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꖵ","out":"ŋgu"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꗏ","out":"lɔ"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꗪ","out":"ɓɛ"} +{"map":"alalc-vai-Vaii-Latn-2010","src":"ꘇ","out":"gɛ̃"} +{"map":"alalc-zgh-Tfng-Latn-2012","src":"ⴷ","out":"d"} +{"map":"alalc-zgh-Tfng-Latn-2012","src":"ⵛ","out":"c"} +{"map":"alalc-zho-Hani-Latn-2012","src":"尔","out":"er"} +{"map":"alalc-zho-Hani-Latn-2012","src":"史","out":"shi"} +{"map":"alalc-zho-Latn-Latn-2012","src":"ssu","out":"si"} +{"map":"alalc-zho-Latn-Latn-2012","src":"hsiao","out":"xiao"} +{"map":"alalc-zsm-Arab-Latn-2011","src":"ض","out":"d"} +{"map":"alalc-zsm-Arab-Latn-2011","src":"قودوس","out":"kudus"} +{"map":"apcbg-bul-Cyrl-Latn-1995","src":"Чакъров остров","out":"Chakarov ostrov"} +{"map":"apcbg-bul-Cyrl-Latn-1995","src":"залив Лазурен бряг","out":"zaliv Lazuren bryag"} +{"map":"apcbg-bul-Cyrl-Latn-1995","src":"остров Рогулят","out":"ostrov Rogulyat"} +{"map":"apcbg-bul-Cyrl-Latn-1995","src":"остров Вълчедръм","out":"ostrov Valchedram"} +{"map":"bas-rus-Cyrl-Latn-2017-bss","src":"Ручьи","out":"Ruchyi"} +{"map":"bgn-kor-Hang-Latn-1943","src":"평양","out":"P’yŏngyang"} +{"map":"bgna-bul-Cyrl-Latn-2006","src":"ледник Етър","out":"lednik Etar"} +{"map":"bgna-bul-Cyrl-Latn-2006","src":"нос Никюп","out":"nos Nikyup"} +{"map":"bgna-bul-Cyrl-Latn-2006","src":"ледник Сигмен","out":"lednik Sigmen"} +{"map":"bgna-bul-Cyrl-Latn-2006","src":"ледник Збелсурд","out":"lednik Zbelsurd"} +{"map":"bgna-bul-Cyrl-Latn-2009","src":"риф Гергини","out":"rif Gergini"} +{"map":"bgna-bul-Cyrl-Latn-2009","src":"Оряховски възвишения","out":"Oryahovski vazvisheniya"} +{"map":"bgna-bul-Cyrl-Latn-2009","src":"залив Слънчев бряг","out":"zaliv Slanchev bryag"} +{"map":"bgna-bul-Cyrl-Latn-2009","src":"залив Златни пясъци","out":"zaliv Zlatni pyasatsi"} +{"map":"bgnpcgn-ady-Cyrl-Latn-2012","src":"Е","out":"E"} +{"map":"bgnpcgn-ady-Cyrl-Latn-2012","src":"кӀу","out":"kw’"} +{"map":"bgnpcgn-ady-Cyrl-Latn-2012","src":"С","out":"S"} +{"map":"bgnpcgn-ady-Cyrl-Latn-2012","src":"цӀ","out":"ts’"} +{"map":"bgnpcgn-ady-Cyrl-Latn-2012","src":"Ь","out":"’"} +{"map":"bgnpcgn-amh-Ethi-Latn-1967","src":"ቋንቋ የድምጽ፣ የምልክት ወይም የምስል ቅንብር ሆኖ","out":"k’wank’wa yedmts’፣ yemlkt weym yemsl k’nbr hono"} +{"map":"bgnpcgn-amh-Ethi-Latn-1967","src":"ናይሎ ሳህራን","out":"naylo sahran"} +{"map":"bgnpcgn-ara-Arab-Latn-1956","src":"قُرآن","out":"Qur’ān"} +{"map":"bgnpcgn-ara-Arab-Latn-1956","src":"حَلَب","out":"Ḩalab"} +{"map":"bgnpcgn-ara-Arab-Latn-1956","src":"سَلْمان پَاك","out":"Salmān Pāk"} +{"map":"bgnpcgn-av-Cyrl-Latn-2011","src":"рукъ","out":"ruq’"} +{"map":"bgnpcgn-ava-Cyrl-Latn-2011","src":"ж","out":"zh"} +{"map":"bgnpcgn-ava-Cyrl-Latn-2011","src":"О","out":"O"} +{"map":"bgnpcgn-ava-Cyrl-Latn-2011","src":"ц","out":"ts"} +{"map":"bgnpcgn-ava-Cyrl-Latn-2011","src":"ъе","out":"’’e"} +{"map":"bgnpcgn-bal-Arab-Latn-2008","src":"دامان","out":"Dāmān"} +{"map":"bgnpcgn-bel-Cyrl-Latn-1979","src":"Нёман","out":"Nyoman"} +{"map":"bgnpcgn-bel-Cyrl-Latn-1979","src":"Пінск","out":"Pinsk"} +{"map":"bgnpcgn-bel-Cyrl-Latn-1979","src":"Шчара","out":"Shchara"} +{"map":"bgnpcgn-bul-Cyrl-Latn-2013","src":"София-Град","out":"Sofia-Grad"} +{"map":"bgnpcgn-chv-Cyrl-Latn-2011","src":"Е","out":"Ye"} +{"map":"bgnpcgn-chv-Cyrl-Latn-2011","src":"п","out":"p"} +{"map":"bgnpcgn-chv-Cyrl-Latn-2011","src":"Щ","out":"Shch"} +{"map":"bgnpcgn-cv-Cyrl-Latn-2011","src":"ҫын","out":"śyn"} +{"map":"bgnpcgn-div-Thaa-Latn-1972","src":"ޝަހީދުންގެ ދުވަސް","out":"shahīdunge duvas"} +{"map":"bgnpcgn-dzo-Tibt-Latn-2010","src":"ཏ","out":"ta"} +{"map":"bgnpcgn-dzo-Tibt-Latn-2010","src":"ཀུ","out":"ku"} +{"map":"bgnpcgn-dzo-Tibt-Latn-2010","src":"སྲ","out":"sa"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Γοίθιος","out":"Goíthios"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Άρτα","out":"Árta"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Ήπειρος","out":"Ípiros"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Κέρκυρα","out":"Kérkira"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Λιβαδειά","out":"Livadhiá"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Πασαλιμάνι","out":"Pasalimáni"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Σκιάθος","out":"Skiáthos"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Αβάνα","out":"Avána"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Μάλαγα","out":"Málaga"} +{"map":"bgnpcgn-ell-Grek-Latn-1962","src":"Τιρόλο","out":"Tirólo"} +{"map":"bgnpcgn-ell-Grek-Latn-1996","src":"αέρας","out":"aéras"} +{"map":"bgnpcgn-ell-Grek-Latn-1996","src":"Γιαννιτσά","out":"Giannitsá"} +{"map":"bgnpcgn-ell-Grek-Latn-1996","src":"Ιθάκη","out":"Itháki"} +{"map":"bgnpcgn-ell-Grek-Latn-1996","src":"Κορώνη","out":"Koróni"} +{"map":"bgnpcgn-ell-Grek-Latn-1996","src":"Μεταξουργείο","out":"Metaxourgeío"} +{"map":"bgnpcgn-ell-Grek-Latn-1996","src":"Πήλιο","out":"Pílio"} +{"map":"bgnpcgn-ell-Grek-Latn-1996","src":"Σφακιά","out":"Sfakiá"} +{"map":"bgnpcgn-ell-Grek-Latn-1996","src":"Βερόνα","out":"Veróna"} +{"map":"bgnpcgn-ell-Grek-Latn-1996","src":"Νέα Υόρκη","out":"Néa Yórki"} +{"map":"bgnpcgn-fao-Latn-Latn-1968","src":"Fyrirgefðu","out":"Fyrirgefdhu"} +{"map":"bgnpcgn-iu-Cans-Latn-2013","src":"ᑐ","out":"Tu"} +{"map":"bgnpcgn-iu-Cans-Latn-2013","src":"ᒻ","out":"M"} +{"map":"bgnpcgn-iu-Cans-Latn-2013","src":"ᔫ","out":"Juu"} +{"map":"bgnpcgn-iu-Cans-Latn-2013","src":"ᖏ","out":"Ngi"} +{"map":"bgnpcgn-iu-Cans-Latn-2013","src":"ᓇᐅᔮᑦ","out":"Naujaat"} +{"map":"bgnpcgn-jpn-Hrkt-Latn-1976","src":"けいだい-かわら","out":"Keidai-kawara"} +{"map":"bgnpcgn-jpn-Hrkt-Latn-1976","src":"なす がわ","out":"Nasu Gawa"} +{"map":"bgnpcgn-jpn-Hrkt-Latn-1976","src":"ぽっぽっや","out":"Poppoyya"} +{"map":"bgnpcgn-kaz-Cyrl-Latn-1979","src":"Өгізтөбе Тауы","out":"Ögiztöbe Taūy"} +{"map":"bgnpcgn-kaz-Cyrl-Latn-1979","src":"Цуриковка","out":"Tsūrīkovka"} +{"map":"bgnpcgn-kaz-Cyrl-Latn-1979","src":"Қазақстан","out":"Qazaqstan"} +{"map":"bgnpcgn-kbd-Cyrl-Latn-2011","src":"е","out":"e"} +{"map":"bgnpcgn-kbd-Cyrl-Latn-2011","src":"Кхъ","out":"Q"} +{"map":"bgnpcgn-kbd-Cyrl-Latn-2011","src":"т","out":"t"} +{"map":"bgnpcgn-kbd-Cyrl-Latn-2011","src":"Щ","out":"Ś"} +{"map":"bgnpcgn-kir-Cyrl-Latn-1979","src":"Чирик-Сай","out":"Chirik-Say"} +{"map":"bgnpcgn-kir-Cyrl-Latn-1979","src":"Метеорологическая Станция Чамкал","out":"Meteorologicheskaya Stantsiya Chamkal"} +{"map":"bgnpcgn-kir-Cyrl-Latn-1979","src":"Ак-Суу","out":"Ak-Suu"} +{"map":"bgnpcgn-kor-Hang-Latn-kn-1945","src":"원신-리","out":"Wŏnsil-li"} +{"map":"bgnpcgn-kor-Hang-Latn-rok-2011","src":"남산리","out":"Namsan-ri"} +{"map":"bgnpcgn-krc-Cyrl-Latn-2008","src":"В","out":"V"} +{"map":"bgnpcgn-krc-Cyrl-Latn-2008","src":"къ","out":"q"} +{"map":"bgnpcgn-krc-Cyrl-Latn-2008","src":"Х","out":"X"} +{"map":"bgnpcgn-krc-Cyrl-Latn-2008","src":"у","out":"u"} +{"map":"bgnpcgn-mkd-Cyrl-Latn-1981","src":"Прлиќ","out":"Prlić"} +{"map":"bgnpcgn-mkd-Cyrl-Latn-2013","src":"Испраена Плоча","out":"Ispraena Ploča"} +{"map":"bgnpcgn-mon-Cyrl-Latn-1964","src":"Хонгор","out":"Hongor"} +{"map":"bgnpcgn-mon-Cyrl-Latn-1964","src":"Бор-Өндөр Сум","out":"Bor-Öndör Sum"} +{"map":"bgnpcgn-nep-Deva-Latn-2011","src":"प्रशंसा","out":"parshṃsā"} +{"map":"bgnpcgn-os-Cyrl-Latn-2009","src":"Республикӕ","out":"Respublikæ"} +{"map":"bgnpcgn-oss-Cyrl-Latn-2009","src":"Г","out":"G"} +{"map":"bgnpcgn-oss-Cyrl-Latn-2009","src":"къ","out":"k’"} +{"map":"bgnpcgn-oss-Cyrl-Latn-2009","src":"Хъ","out":"Q"} +{"map":"bgnpcgn-oss-Cyrl-Latn-2009","src":"я","out":"ya"} +{"map":"bgnpcgn-prs-Arab-Latn-2007","src":"پُوټَكَى","out":"Pōṯakay"} +{"map":"bgnpcgn-prs-Arab-Latn-2007","src":"مَزَارِ شَرِيف","out":"Mazār-e Sharīf"} +{"map":"bgnpcgn-prs-Arab-Latn-yaghoubi","src":"کُوْټ","out":"kōt"} +{"map":"bgnpcgn-pus-Arab-Latn-1968","src":"حَضْرَتِ سُلْطَان","out":"Ḩaẕrat-e Sulţān"} +{"map":"bgnpcgn-ron-Cyrl-Latn-2002","src":"Ну неам вэзут де ун кар де ань!","out":"Nu neam văzut de un car de ani!"} +{"map":"bgnpcgn-rue-Cyrl-Latn-2016","src":"русиньскый язык","out":"rusyn'skyj yazyk"} +{"map":"bgnpcgn-rus-Cyrl-Latn-1947","src":"Он видел её в первый раз","out":"On videl yeyë v pervyy raz"} +{"map":"bgnpcgn-sah-Cyrl-Latn-2012","src":"е","out":"ye"} +{"map":"bgnpcgn-sah-Cyrl-Latn-2012","src":"О","out":"O"} +{"map":"bgnpcgn-sah-Cyrl-Latn-2012","src":"Ч","out":"Ch"} +{"map":"bgnpcgn-sme-Latn-Latn-1984","src":"ÁEL","out":"ÁEL"} +{"map":"bgnpcgn-srp-Cyrl-Latn-1962","src":"Ервеник","out":"Ervenik"} +{"map":"bgnpcgn-srp-Cyrl-Latn-2005","src":"Доње Љупче","out":"Donje Ljupče"} +{"map":"bgnpcgn-syr-Syrc-Latn-2011","src":"ܘ","out":"w"} +{"map":"bgnpcgn-tat-Cyrl-Latn-2007","src":"Гыйльмиев","out":"Ğil’miew"} +{"map":"bgnpcgn-tgk-Cyrl-Latn-1994","src":"ғор","out":"ghor"} +{"map":"bgnpcgn-tgk-Cyrl-Latn-1994","src":"талаб","out":"talab"} +{"map":"bgnpcgn-tha-Thai-Latn-2002","src":"เขา","out":"khao"} +{"map":"bgnpcgn-tir-Ethi-Latn-2007","src":"አዲስ ዘመን (ከተማ)","out":"’edisĭ zemenĭ (ketema)"} +{"map":"bgnpcgn-tir-Ethi-Latn-2007","src":"አልሞት ባይ ተጋዳይ","out":"’elĭmotĭ bayĭ tegadayĭ"} +{"map":"bgnpcgn-tuk-Cyrl-Latn-1979","src":"Бүзмейин","out":"Büzmeyin"} +{"map":"bgnpcgn-tuk-Cyrl-Latn-1993","src":"Чаршаңңы","out":"Çarşaňňy"} +{"map":"bgnpcgn-udm-Cyrl-Latn-2011","src":"З","out":"Z"} +{"map":"bgnpcgn-udm-Cyrl-Latn-2011","src":"р","out":"r"} +{"map":"bgnpcgn-udm-Cyrl-Latn-2011","src":"Ь","out":"’"} +{"map":"bgnpcgn-ukr-Cyrl-Latn-1965","src":"Ивахи","out":"Yvakhy"} +{"map":"bgnpcgn-ukr-Cyrl-Latn-2019","src":"Гадяч","out":"Hadiach"} +{"map":"bgnpcgn-ukr-Cyrl-Latn-2019","src":"Ужгород","out":"Uzhhorod"} +{"map":"bgnpcgn-urd-Arab-Latn-2007","src":"أَحمَدِي شَامَا","out":"Aḩmadī Shāmā"} +{"map":"bgnpcgn-urd-Arab-Latn-2007","src":"خَان گھَڑِی","out":"Khān Ghaṛī"} +{"map":"bgnpcgn-uzb-Cyrl-Latn-1979","src":"ПАПАПАЧУКА Респект!","out":"PAPAPACHUKA Respekt!"} +{"map":"bis-asm-Beng-Latn-13194-1991","src":"লখিমপুৰ জিলাৰ নাৰায়ণপুৰৰ বৰপথাৰত আজি প্ৰশান্তি ধাম নামেৰে এখন বৃদ্ধাশ্ৰমৰ শুভাৰম্ভ কৰা হয়","out":"lkhimpur jilār nārāẏṇpurr brpthārt āji prśānti dhām nāmērē ēkhn bṛddhāśrmr śubhārmbh krā hẏ"} +{"map":"bis-guj-Gujr-Latn-13194-1991","src":"લિબિયાના એલ અજિજિયામાં ધરતી પર સૌથી વધુ તાપમાન નોંધાયું. એ વખતે છાયામાં નોંધવામાં આવેલું તાપમાન 58 ડિગ્રી સેલ્સિયસ હતું.","out":"libiyānā ēl ajijiyāmāṃ dhrtī pr sauthī vdhu tāpmān nŏndhāyuṃ. ē vkhtē chāyāmāṃ nŏndhvāmāṃ āvēluṃ tāpmān 58 ḍigrī sēlsiys htuṃ."} +{"map":"bis-mlm-Mlym-Latn-13194-1991","src":"ഏറ്റവും ചെറുപ്പം ജോയി; ജയലക്ഷ്മി, ദീപ്തി, ജ്യോതി; പട്ടികയിലെ നിര ഇങ്ങനെ‌","out":"ēṟṟvuṃ ceṟuppṃ jōyi; jylkṣmi, dīpti, jyōti; pṭṭikyile nir iṅṅne"} +{"map":"bis-tel-Telu-Latn-13194-1991","src":"ఆ సంతోషాన్ని అభిమానులతో పంచుకున్నారు","out":"ā sntŏṣānni abhimānultŏ pñcukunnāru"} +{"map":"bsi-bel-Cyrl-Latn-1958","src":"Ъ","out":"”"} +{"map":"bsi-bel-Cyrl-Latn-1958","src":"у","out":"u"} +{"map":"bsi-bul-Cyrl-Latn-1958","src":"к","out":"k"} +{"map":"bsi-chu-Cyrl-Latn-1958","src":"Е","out":"E"} +{"map":"bsi-chu-Cyrl-Latn-1958","src":"о","out":"o"} +{"map":"bsi-chu-Cyrl-Latn-1958","src":"Ъ","out":"Ŭ"} +{"map":"bsi-chu-Cyrl-Latn-1958","src":"ѱ","out":"ps"} +{"map":"bsi-ell-Grek-Latn-1958","src":"Λ","out":"L"} +{"map":"bsi-ell-Grek-Latn-1958","src":"Ψ","out":"Ps"} +{"map":"bsi-kor-Kore-Latn-6505-1982","src":"어","out":"e"} +{"map":"bsi-mkd-Cyrl-Latn-1958","src":"ѕ","out":"dz"} +{"map":"bsi-mkd-Cyrl-Latn-1958","src":"ћ","out":"ć"} +{"map":"bsi-ron-Cyrl-Latn-1958","src":"и","out":"i"} +{"map":"bsi-ron-Cyrl-Latn-1958","src":"с","out":"s"} +{"map":"bsi-ron-Cyrl-Latn-1958","src":"Ѣ","out":"Ea"} +{"map":"bsi-rus-Cyrl-Latn-1958","src":"Известия","out":"Izvestiya"} +{"map":"bsi-rus-Cyrl-Latn-1958","src":"Й","out":"Ĭ"} +{"map":"bsi-rus-Cyrl-Latn-1958","src":"ф","out":"f"} +{"map":"bsi-rus-Cyrl-Latn-1958","src":"Ѣ","out":"Ě"} +{"map":"bsi-srp-Cyrl-Latn-1958","src":"к","out":"k"} +{"map":"bsi-ukr-Cyrl-Latn-1958","src":"Ѣ","out":"Ě"} +{"map":"by-bel-Cyrl-Latn-1998","src":"Нясвіж","out":"Niasviž"} +{"map":"by-bel-Cyrl-Latn-2007","src":"Аршанскi","out":"Aršanski"} +{"map":"by-bel-Cyrl-Latn-2007","src":"Талачын","out":"Talačyn"} +{"map":"din-ab-Cyrl-Latn-1460-2-2011","src":"г","out":"g"} +{"map":"din-ara-Arab-Latn-31635-2011","src":"ض","out":"ḍ"} +{"map":"din-ara-Arab-Latn-31635-2011","src":"اِبْن","out":"ibn"} +{"map":"din-av-Cyrl-Latn-1460-2-2011","src":"г","out":"g"} +{"map":"din-crh-Cyrl-Latn-1460-2-2011","src":"a","out":"a"} +{"map":"din-evn-Cyrl-Latn-1460-2-2011","src":"б","out":"b"} +{"map":"din-fas-Arab-Latn-31635-2011","src":"ف","out":"f"} +{"map":"din-gag-Cyrl-Latn-1460-2-2011","src":"a","out":"a"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Ἐϊγιαφιάτλαγιοκουτλ","out":"Eïgiaphiatlagiokoutl"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Ἅγιον Όρος","out":"Hagion Oros"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Διόνυσος","out":"Dionysos"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Καλαμάτα","out":"Kalamata"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Κυκλάδες","out":"Kyklades"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Μυτιλήνη","out":"Mytilēnē"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Πύλος","out":"Pylos"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Τσακωνιὰ","out":"Tsakōnia"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Καλιφόρνια","out":"Kaliphornia"} +{"map":"din-grc-Grek-Latn-31634-2011-t1","src":"Πολυνησία","out":"Polynēsia"} +{"map":"din-heb-Hebr-Latn-31636-2018","src":"תּוֹרָה","out":"torah"} +{"map":"din-heb-Hebr-Latn-31636-2018","src":"ם","out":"m"} +{"map":"din-heb-Hebr-Latn-31636-2018","src":"טʹ","out":"ṭʹ"} +{"map":"din-hye-Armn-Latn-32706-2010","src":"Բ","out":"B"} +{"map":"din-hye-Armn-Latn-32706-2010","src":"ծ","out":"c"} +{"map":"din-hye-Armn-Latn-32706-2010","src":"Ջ","out":"J̌"} +{"map":"din-inh-Cyrl-Latn-1460-2-2011","src":"a","out":"a"} +{"map":"din-kaa-Cyrl-Latn-1460-2-2011","src":"в","out":"v"} +{"map":"din-kat-Geor-Latn-32707-2010","src":"ჯართი","out":"ǰart̕i"} +{"map":"din-kca-Cyrl-Latn-1460-2-2011-s62","src":"в","out":"v"} +{"map":"din-krc-Cyrl-Latn-1460-2-2011-s7","src":"a","out":"a"} +{"map":"din-kur-Arab-Latn-31635-2011","src":"س","out":"s"} +{"map":"din-kur-Arab-Latn-31635-2011","src":"گوڵ","out":"guḻ"} +{"map":"din-lbe-Cyrl-Latn-1460-2-2011","src":"б","out":"b"} +{"map":"din-mns-Cyrl-Latn-1460-2-2011","src":"a","out":"a"} +{"map":"din-nep-Deva-Latn-33904-2018","src":"चैत पहिलो साता घर आएका उनी लकडाउन भएपछि यतै रोकिए","out":"caita pahilo sātā ghara āekā unī lakaḍāuna bhaepachi yatai rokie"} +{"map":"din-pra-Deva-Latn-33904-2018","src":"गुणाश्रये गुणमये नारायणि नमोऽस्तु ते","out":"guṇāśraye guṇamaye nārāyaṇi namo’stu te"} +{"map":"din-sel-Cyrl-Latn-1460-2-2011","src":"a","out":"a"} +{"map":"din-tk-Cyrl-Latn-1460-2-2011","src":"б","out":"b"} +{"map":"din-urd-Arab-Latn-31635-2011","src":"ج","out":"j"} +{"map":"din-urd-Arab-Latn-31635-2011","src":"ن","out":"n"} +{"map":"din-xal-Cyrl-Latn-1460-2-2011","src":"a","out":"a"} +{"map":"din-yid-Hebr-Latn-31636-2018","src":"ן","out":"n"} +{"map":"din-yid-Hebr-Latn-31636-2018","src":"אַ","out":"a"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"γκέγκε","out":"gkégke"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"Αλεξανδρούπολη","out":"Alexandroúpoli̱"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"Έδεσσα","out":"Édessa"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"Καρπενήσι","out":"Karpení̱si"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"Λαμία","out":"Lamía"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"Νέα Σμύρνη","out":"Néa Smýrni̱"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"Σαλαμίνα","out":"Salamína"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"Χάλκη","out":"Chálki̱"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"Κωνσταντινούπολη","out":"Ko̱nstantinoúpoli̱"} +{"map":"elot-ell-Grek-Latn-743-1982-tl","src":"Σκόπια","out":"Skópia"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"μπέικον","out":"béikon"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"Βελούχι","out":"Veloúchi"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"Ηράκλειο","out":"Irákleio"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"Κεφαλλονιά","out":"Kefalloniá"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"Μακεδονία","out":"Makedonía"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"Πατήσια","out":"Patísia"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"Σκόπελος","out":"Skópelos"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"Αγγλία","out":"Anglía"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"Μασσαλία","out":"Massalía"} +{"map":"elot-ell-Grek-Latn-743-1982-ts","src":"Τορίνο","out":"Toríno"} +{"map":"elot-ell-Grek-Latn-743-2001-ts","src":"Αμοργός","out":"Amorgós"} +{"map":"elot-ell-Grek-Latn-743-2001-ts","src":"Καβάλα","out":"Kavála"} +{"map":"elot-ell-Grek-Latn-743-2001-ts","src":"Μαρκόπουλο","out":"Markópoulo"} +{"map":"elot-ell-Grek-Latn-743-2001-ts","src":"Ρέθυμνο","out":"Réthymno"} +{"map":"elot-ell-Grek-Latn-743-2001-ts","src":"Άμστερνταμ","out":"Ámsterntam"} +{"map":"elot-ell-Grek-Latn-743-2001-ts","src":"Τζαμάικα","out":"Tzamáika"} +{"map":"gki-bel-Cyrl-Latn-2000","src":"Добруш","out":"Dobruš"} +{"map":"gki-bel-Cyrl-Latn-2000","src":"Цёмны Лес","out":"Ciomny Lies"} +{"map":"gost-rus-Cyrl-Latn-16876-71-1983","src":"Идрица","out":"Idrica"} +{"map":"gost-rus-Cyrl-Latn-16876-71-1983","src":"Юрюзань","out":"Ûrûzan´"} +{"map":"gost-rus-Cyrl-Latn-7.79-2000-2002","src":"физика","out":"fizika"} +{"map":"icao-bel-Cyrl-Latn-9303","src":"Міховіч Марыя","out":"Mikhovich Maryia"} +{"map":"icao-bel-Cyrl-Latn-9303","src":"ќ","out":"k"} +{"map":"icao-mkd-Cyrl-Latn-9303","src":"К","out":"K"} +{"map":"icao-mul-Latn-Latn-2015","src":"Ä","out":"AE"} +{"map":"icao-mul-Latn-Latn-2015","src":"Ž","out":"Z"} +{"map":"icao-srp-Cyrl-Latn-9303","src":"Ђ","out":"D"} +{"map":"icao-ukr-Cyrl-Latn-9303","src":"Є","out":"IE"} +{"map":"iso-ara-Arab-Latn-233-2-1993","src":"مِصر","out":"Miṣr"} +{"map":"iso-ben-Beng-Latn-15919-2001","src":"ওদিকে সদ্য করোনা থেকে ফিরে এসে দাপটের সঙ্গে পিএসজির হয়ে খেলে যাওয়া দি মারিয়া কেন ডাক পাননি, কেউ জানে না","out":"odaikae sadaya karaonaā thaekae phairae esae daāpaṭaera saṅagae paiesajaira haẏae khaelae yaāoẏaā dai maāraiẏaā kaena ḍaāka paānanai, kaeu jaānae naā"} +{"map":"iso-ell-Grek-Latn-843-1997-t1","src":"Εΐτζι","out":"Eḯtzi"} +{"map":"iso-ell-Grek-Latn-843-1997-t1","src":"Γαλαξίδι","out":"Galaxídi"} +{"map":"iso-ell-Grek-Latn-843-1997-t1","src":"Θήβα","out":"Thī́va"} +{"map":"iso-ell-Grek-Latn-843-1997-t1","src":"Κομοτηνή","out":"Komotīnī́"} +{"map":"iso-ell-Grek-Latn-843-1997-t1","src":"Μέγαρα","out":"Mégara"} +{"map":"iso-ell-Grek-Latn-843-1997-t1","src":"Περιστέρι","out":"Peristéri"} +{"map":"iso-ell-Grek-Latn-843-1997-t1","src":"Σύμη","out":"Sýmī"} +{"map":"iso-ell-Grek-Latn-843-1997-t1","src":"Βενετία","out":"Venetía"} +{"map":"iso-ell-Grek-Latn-843-1997-t1","src":"Νάπολη","out":"Nápolī"} +{"map":"iso-ell-Grek-Latn-843-1997-t2","src":"Ένα πράμα μόνον με παρακίνησε κι εμένα να γράψω ότι τούτην την πατρίδα την έχομεν όλοι μαζί, και σοφοί κι αμαθείς και πλούσιοι και φτωχοί και πολιτικοί και στρατιωτικοί και οι πλέον μικρότεροι άνθρωποι· όσοι αγωνιστήκαμεν, αναλόγως ο καθείς, έχομεν να ζήσομεν εδώ. Το λοιπόν δουλέψαμεν όλοι μαζί, να την φυλάμεν κι όλοι μαζί και να μην λέγει ούτε ο δυνατός «εγώ» ούτε ο αδύνατος. Ξέρετε πότε να λέγει ο καθείς «εγώ»; Όταν αγωνιστεί μόνος του και φκιάσει ή χαλάσει, να λέγει «εγώ»· όταν όμως αγωνίζονται πολλοί και φκιάνουν, τότε να λένε «εμείς». Είμαστε εις το «εμείς» κι όχι εις το «εγώ». Και εις το εξής να μάθομεν γνώση, αν θέλομεν να φκιάσομεν χωριόν, να ζήσομεν όλοι μαζί.\n\nΓιάννης Μακρυγιάννης.\n","out":"Éna práma mónon me parakínise ki eména na grápso óti toútin tin patrída tin échomen óloi mazí, kai sofoí ki amatheís kai ploúsioi kai ftochoí kai politikoí kai stratiotikoí kai oi pléon mikróteroi ánthropoi; ósoi agonistíkamen, analógos o katheís, échomen na zísomen edó. To loipón doulépsamen óloi mazí, na tin fylámen ki óloi mazí kai na min légei oúte o dynatós «egó» oúte o adýnatos. Xérete póte na légei o katheís «egó»? Ótan agonisteí mónos tou kai fkiásei í chalásei, na légei «egó»; ótan ómos agonízontai polloí kai fkiánoun, tóte na léne «emeís». Eímaste eis to «emeís» ki óchi eis to «egó». Kai eis to exís na máthomen gnósi, an thélomen na fkiásomen chorión, na zísomen óloi mazí.\n\nGiánnis Makrygiánnis.\n"} +{"map":"iso-hin-Deva-Latn-15919-2001","src":"सीडीसी चीफ का बयान अहम","out":"saīḍaīsaī caīpha kaā bayaāna ahama"} +{"map":"iso-kan-Kana-Latn-15919-2001","src":"ಶಾಸಕರಿಂದಲೂ ಒತ್ತಡ?","out":"śaāsakaraiṁdalaū otataḍa?"} +{"map":"iso-kat-Geor-Latn-9984-1996","src":"აუალიცა","out":"aualic̕a"} +{"map":"iso-kor-Hang-Latn-1996-method1","src":"안자라","out":"ancara"} +{"map":"iso-kor-Hang-Latn-1996-method2","src":"바께","out":"ba'gge"} +{"map":"iso-mar-Deva-Latn-15919-2001","src":"सांताक्रूझ-चेंबूर लिंक रोडवरील उन्नत मार्गाला स्थगिती","out":"saāṁtaākaraūjha-caeṁbaūra laiṁka raoḍavaraīla unanata maāragaālaā sathagaitaī"} +{"map":"iso-ori-Orya-Latn-15919-2001","src":"ନବନିଯୁକ୍ତ ଓଡିଶା କଂଗ୍ରେସ ପ୍ରଭାରୀ ଏ.ଚେଲ୍ଲା କୁମାରଙ୍କୁ କରୋନା","out":"nabanaiyaukata oḍaiśaā kaṁgaraesa parabhaāraī e.caelalaā kaumaāraṅakau karaonaā"} +{"map":"iso-pli-Deva-Latn-15919-2001","src":"तत्थ सुदिन्‍नो नाम कलन्दपुत्तो सेट्ठिपुत्तो होति","out":"tatatha saudainanao naāma kalanadapautatao saeṭaṭhaipautatao haotai"} +{"map":"iso-pli-Thai-Latn-15919-2001","src":"อกาโล โข, มาณวก, อตฺถิ เม อชฺช เภสชฺชมตฺตา ปีตา, อปฺเปว นาม สฺเวปิ อุปสงฺกเมยฺยามา","out":"xkāol ok̄h, māṇwk, xt–̥t̄hi em xch–̥ch ep̣hs̄ch–̥chmt–̥tā pītā, xp–̥epw nām s̄–̥ewpi xups̄ng–̥kemy–̥yāmā"} +{"map":"iso-san-Deva-Latn-15919-2001","src":"यो न हृष्यति न द्वेष्टि न शोचति न काङ्‍क्षति","out":"yao na haṛṣayatai na davaeṣaṭai na śaocatai na kaāṅakaṣatai"} +{"map":"iso-tel-Telu-Latn-15919-2001","src":"శ్రియ సినిమా సెట్‌లో అడుగుపెట్టి ఆరు నెలలు కావొస్తోంది","out":"śaraiya sainaimaā saeṭalaō aḍaugaupaeṭaṭai ārau naelalau kaāvaosataōṁdai"} +{"map":"kp-kor-Hang-Latn-2002","src":"압록강","out":"Amrokgang"} +{"map":"masm-mon-Cyrl-Latn-5217-2012","src":"Ишиг, бичиг, хань","out":"Ishig, bichig, khani"} +{"map":"masm-mon-Latn-Cyrl-5217-2012","src":"Avarga, khalbaga, aav","out":"Аварга, халбага, аав"} +{"map":"masm-mon-Latn-Cyrl-5217-2012","src":"Tsatsag, tsetseg","out":"Цацаг, цэцэг"} +{"map":"moct-kor-Hang-Latn-2000","src":"묵호","out":"Mukho"} +{"map":"mofa-jpn-Hrkt-Latn-1989","src":"ヒュウガ","out":"HYUGA"} +{"map":"mv-div-Thaa-Latn-1987","src":"ދަރިވަރުންނާއި","out":"dharivarun’n’aai"} +{"map":"mvd-rus-Cyrl-Latn-2008","src":"Ева","out":"Eva"} +{"map":"odni-ara-Arab-Latn-2004","src":"نُورُالدِين","out":"Nur al Din"} +{"map":"odni-bel-Cyrl-Latn-2015","src":"Кастусь Каліноўскі","out":"Kastus Kalinowski"} +{"map":"odni-che-Cyrl-Latn-2015","src":"Ильяс Ахмадкӏант","out":"Ilyas Akhmadkant"} +{"map":"odni-hin-Deva-Latn-2004","src":"समीर","out":"smir"} +{"map":"odni-kir-Cyrl-Latn-2015","src":"Гульжигит Калыков","out":"Guljigit Kalykov"} +{"map":"odni-kur-Arab-Latn-2011","src":"ئاواره","out":"Awara"} +{"map":"odni-prs-Arab-Latn-2004","src":"صَفَّار","out":"saffar"} +{"map":"odni-pus-Arab-Latn-2011","src":"قَيُّوم","out":"Qayyum"} +{"map":"odni-srp-Cyrl-Latn-2015","src":"Пролеће","out":"Prolece"} +{"map":"odni-ukr-Cyrl-Latn-2015","src":"Олег","out":"Oleh"} +{"map":"odni-ukr-Cyrl-Latn-2015","src":"Новофедорівка","out":"Novofedorivka"} +{"map":"odni-zho-Hani-Latn-2015","src":"毛","out":"Mao"} +{"map":"odni-zho-Hani-Latn-2015","src":"金","out":"Jin"} +{"map":"odni-zho-Hani-Latn-2015","src":"唐","out":"Tang"} +{"map":"odni-zho-Hani-Latn-2015","src":"董","out":"Dong"} +{"map":"odni-zho-Hani-Latn-2015","src":"谢","out":"Xie"} +{"map":"odni-zho-Hani-Latn-2015","src":"luo jiahui","out":"Luo Jiahui"} +{"map":"sasm-mon-Mong-Latn-general-1978","src":"ᠤᠯᠠᠭᠠᠨᠴᠠᠪ ᠬᠣᠲᠠ","out":"ulaganqab hota"} +{"map":"sasm-mon-Mong-Latn-general-1978","src":"ᠣᠲᠣᠭ ᠬᠣᠰᠢᠭᠤ","out":"otog hosigu"} +{"map":"sasm-mon-Mong-Latn-general-1978","src":"ᠡᠵᠡᠨ᠎ᠡ ᠬᠣᠰᠢᠭᠤ","out":"ejen-e hosigu"} +{"map":"sasm-mon-Mong-Latn-general-1978","src":"ᠲᠠᠶᠢᠫᠤᠰᠧ ᠬᠣᠰᠢᠭᠤ","out":"tayipuse hosigu"} +{"map":"sasm-mon-Mong-Latn-phonetic-1978","src":"ᠬᠠᠶᠢᠷᠤᠪ ᠤᠨ ᠲᠣᠬᠣᠢ ᠲᠣᠭᠣᠷᠢᠭ","out":"hayirûb-ûn tôhôi tôgôrig"} +{"map":"sasm-mon-Mong-Latn-phonetic-1978","src":"ᠰᠢᠨ᠎ᠡ ᠪᠠᠷᠭᠤ ᠪᠠᠷᠠᠭᠤᠨ ᠬᠣᠰᠢᠭᠤ","out":"sin-e bargû baragûn hôsigû"} +{"map":"sasm-mon-Mong-Latn-phonetic-1978","src":"ᠠᠯᠠᠱᠠ ᠪᠠᠷᠠᠭᠤᠨ ᠬᠣᠰᠢᠭᠤ","out":"alaxa baragûn hôsigû"} +{"map":"sasm-mon-Mong-Latn-phonetic-1978","src":"ᠲᠣᠭᠲᠠᠬᠤ ᠰᠢᠶᠠᠨ","out":"tôgtahû siyan"} +{"map":"stategeocadastre-ukr-Cyrl-Latn-1993","src":"Верховина","out":"Verkhovyna"} +{"map":"stategeocadastre-ukr-Cyrl-Latn-1993","src":"Форос","out":"Foros"} +{"map":"ua-ukr-Cyrl-Latn-1996","src":"Іршава","out":"Irshava"} +{"map":"ua-ukr-Cyrl-Latn-1996","src":"Знам’янка","out":"Znam”ianka"} +{"map":"ua-ukr-Cyrl-Latn-2010","src":"Ґорґани","out":"Gorgany"} +{"map":"ua-ukr-Cyrl-Latn-2010","src":"Коваленко","out":"Kovalenko"} +{"map":"ua-ukr-Cyrl-Latn-2010","src":"Чернівці","out":"Chernivtsi"} +{"map":"un-amh-Ethi-Latn-2016","src":"ለማሰብ ወይም የታሰበን ሃሳብ ለሌላ ለማስተላለፍ የሚረዳ መሳሪያ ነው","out":"Le̠mase̠bi̠ We̠yi̠mi̠ Ye̠tase̠be̠ni̠ Hasabi̠ Le̠lela Le̠masi̠te̠lale̠fi̠ Ye̠mire̠da Me̠sariya Ne̠wi̠"} +{"map":"un-amh-Ethi-Latn-2016","src":"አኙዋክኛ","out":"Anyuwaki̠nya"} +{"map":"un-amh-Ethi-Latn-2016","src":"አዲስ አበባ","out":"Adisi̠ Abe̠ba"} +{"map":"un-ara-Arab-Latn-2017","src":"السُودان","out":"As Sūdān"} +{"map":"un-bel-Cyrl-Latn-2007","src":"Віцебск","out":"Viciebsk"} +{"map":"un-bel-Cyrl-Latn-2007","src":"Шаркаўшчына","out":"Šarkaŭščyna"} +{"map":"un-ben-Beng-Latn-2016","src":"ড়","out":"ṙa"} +{"map":"un-bul-Cyrl-Latn-1977","src":"Чакъров остров","out":"Čakǎrov ostrov"} +{"map":"un-bul-Cyrl-Latn-1977","src":"залив Лазурен бряг","out":"zaliv Lazuren brjag"} +{"map":"un-bul-Cyrl-Latn-1977","src":"остров Рогулят","out":"ostrov Roguljat"} +{"map":"un-bul-Cyrl-Latn-1977","src":"остров Вълчедръм","out":"ostrov Vǎlčedrǎm"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Γοίθιος","out":"ɣiθios"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Άρτα","out":"ɑrtɑ"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Ήπειρος","out":"ipiros"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Κέρκυρα","out":"kɛrkirɑ"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Λιβαδειά","out":"livɑðiɑ"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Πασαλιμάνι","out":"pɑsɑlimɑni"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Σκιάθος","out":"skiɑθos"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Αβάνα","out":"ɑvɑnɑ"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Μάλαγα","out":"mɑlɑɣɑ"} +{"map":"un-ell-Grek-Latn-1987-phonetic","src":"Τιρόλο","out":"tirolo"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Γοίθιος","out":"Goíthios"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Άρτα","out":"Árta"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Ήπειρος","out":"Ípeiros"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Κέρκυρα","out":"Kérkyra"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Λιβαδειά","out":"Livadeiá"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Πασαλιμάνι","out":"Pasalimáni"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Σκιάθος","out":"Skiáthos"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Αβάνα","out":"Avána"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Μάλαγα","out":"Málaga"} +{"map":"un-ell-Grek-Latn-1987-ts","src":"Τιρόλο","out":"Tirólo"} +{"map":"un-hin-Deva-Latn-2016","src":"गंभीर मरीजों के मामले में भारत दूसरे नंबर पर","out":"gaṁbhīr marījoṁ ke māmale meṁ bhārat dūsare naṁbar par"} +{"map":"un-mal-Mlym-Latn-1972","src":"സ്വർണക്കടത്ത്‌: ഫൈസൽ ഫരീദും റബിന്‍സും ദുബായിൽ അറസ്റ്റിലായെന്ന്‌ എന്‍ഐഎ","out":"svarṇakkaṭatt: phaisal pharīduṃ ṟabinsuṃ dubāyil aṟasṟṟilāyĕnn ĕnaiĕ"} +{"map":"un-mar-Deva-Latn-2016","src":"पीएम स्वनिधी कर्ज योजनेला मुंबईतून अल्प प्रतिसाद","out":"pīem svanidhī karj yojanelā muṁbaītūn alp pratisād"} +{"map":"un-mon-Mong-Latn-general-2013","src":"ᠷᠠᠰᠢᠶᠠᠨ ᠬᠣᠲᠠ","out":"rasiyan hota"} +{"map":"un-mon-Mong-Latn-general-2013","src":"ᠴᠢᠩᠱᠠᠨ ᠲᠣᠭᠣᠷᠢᠭ","out":"qingxan togorig"} +{"map":"un-mon-Mong-Latn-general-2013","src":"ᠨᠠᠢᠮᠠᠨ ᠬᠣᠰᠢᠭᠤ","out":"naiman hosigu"} +{"map":"un-mon-Mong-Latn-general-2013","src":"ᠬᠠᠶᠢᠷᠤᠪ ᠤᠨ ᠲᠣᠬᠣᠢ ᠲᠣᠭᠣᠷᠢᠭ","out":"hayirub-un tohoi togorig"} +{"map":"un-mon-Mong-Latn-phonetic-2013","src":"ᠡᠷᠢᠶᠡᠨ ᠬᠣᠲᠠ","out":"eriyen hôta"} +{"map":"un-mon-Mong-Latn-phonetic-2013","src":"ᠳᠦᠩᠾᠧ ᠲᠣᠭᠣᠷᠢᠭ","out":"dunghe tôgôrig"} +{"map":"un-mon-Mong-Latn-phonetic-2013","src":"ᠬᠦᠷᠢᠶ᠎ᠡ ᠬᠣᠰᠢᠭᠤ","out":"huriy-e hôsigû"} +{"map":"un-mon-Mong-Latn-phonetic-2013","src":"ᠰᠢᠨ᠎ᠡ ᠬᠣᠲᠠ ᠲᠣᠭᠣᠷᠢᠭ","out":"sin-e hôta tôgôrig"} +{"map":"un-nep-Deva-Latn-1972","src":"मुद्रा","out":"mudrā"} +{"map":"un-nep-Deva-Latn-2013","src":"प्रशंसा","out":"prashaṁsā"} +{"map":"un-ori-Orya-Latn-1972","src":"ପ୍ରେମ ସମ୍ପର୍କରେ ଭଟ୍ଟା: ରାଗରେ ପ୍ରେମିକାର ତଣ୍ଟି କାଟି ନିଜେ ବିଷ ପିଇଲା ପ୍ରେମିକ","out":"prema samparkare bhaṭṭā: rāgare premikāra taṇṭi kāṭi nije biṣha piilā premika"} +{"map":"un-prs-Arab-Latn-1967","src":"قُرآن","out":"Qor’ān"} +{"map":"un-rus-Cyrl-Latn-1987","src":"Мaймaк","out":"Majmak"} +{"map":"un-rus-Cyrl-Latn-1987","src":"Ямaл","out":"Jamal"} +{"map":"un-srp-Cyrl-Latn-1997","src":"Тресаначка Река","out":"Tresanačka Reka"} +{"map":"un-tam-Taml-Latn-1972","src":"டார்பிடோவை ஏவ உதவும் சூப்பர்சானிக் ஏவுகணையான ஸ்மார்ட் சோதனை வெற்றி","out":"ṭārpiṭovai eva utavum chūpparchāṉik evukaṇaiyāṉa smārṭ chotaṉai vĕṟṟi"} +{"map":"un-tel-Telu-Latn-1972","src":"హైదరాబాదు","out":"haidarābādu"} +{"map":"un-ukr-Cyrl-Latn-2012","src":"Згурський","out":"Zghurskyi"} +{"map":"un-ukr-Cyrl-Latn-2012","src":"Олексій","out":"Oleksii"} +{"map":"un-ukr-Cyrl-Latn-2012","src":"Біла Церква","out":"Bila Tserkva"} +{"map":"un-urd-Arab-Latn-1972","src":"دُرَانِي","out":"Durānī"} +{"map":"un-urd-Arab-Latn-1972","src":"پھاشک","out":"Phāshk"} +{"map":"var-amh-Ethi-Latn-eae-2003","src":"ለሰላም ለፍትህ ለሕዝቦች ነጻነት","out":"läsälamə läfətəhə läḥəzəbočə näṣanätə"} +{"map":"var-amh-Ethi-Latn-eae-2003","src":"ደብረ ማርቆስ","out":"däbərä marəqosə"} +{"map":"var-amh-Ethi-Latn-eae-2003","src":"ራስ ሳይጠና ጉተና","out":"rasə sayəṭäna gutäna"} +{"map":"var-gez-Ethi-Latn-eae-2003","src":"ወኮነ ሌሊተ ወጸብሐ ወኮነ ራብዕተ ዕለተ","out":"wäkonä lelitä wäṣäbəḥa wäkonä rabəʿətä ʿəlätä"} +{"map":"var-jpn-Hrkt-Latn-hepburn-1886","src":"きんようび","out":"kin-yōbi"} +{"map":"var-kor-Hang-Latn-mr-1939","src":"하나님","out":"hananim"} +{"map":"var-kor-Hang-Latn-mr-1939","src":"령반","out":"yŏngban"} +{"map":"var-kor-Hang-Latn-mr-1939","src":"밥","out":"pap"} +{"map":"var-kor-Hang-Latn-mr-1939","src":"민족","out":"minjok"} +{"map":"var-kor-Hang-Latn-mr-1939","src":"쇠뿔","out":"soeppul"} +{"map":"var-kor-Kore-Hang-2013","src":"協力局長協助主義協同組合協同農場南倭北虜","out":"협력국장협조주의협동조합협동농장남왜북로"} +{"map":"var-mon-Mong-Latn-lessing","src":"ᠡᠷᠢᠶᠡᠨ ᠬᠣᠲᠠ","out":"erijen xota"} +{"map":"var-mon-Mong-Latn-lessing","src":"ᠭᠦᠶᠠᠩ ᠰᠢᠶᠠᠨ","out":"gyjang sijan"} +{"map":"var-mon-Mong-Latn-lessing","src":"ᠬᠣᠷᠴᠢᠨ ᠵᠡᠭᠦᠨ ᠭᠠᠷᠤᠨ ᠬᠣᠶᠢᠲᠤ ᠬᠣᠰᠢᠭᠤ","out":"xorcin zegyn γarun xoitu xosiγu"} +{"map":"var-mon-Mong-Latn-lessing","src":"ᠤᠷᠠᠳ ᠤᠨ ᠡᠮᠦᠨᠡᠳᠦ ᠬᠣᠰᠢᠭᠤ","out":"urad-un emynedy xosiγu"} +{"map":"var-mon-Mong-Latn-vpmc","src":"ᠪᠠᠭᠠᠷᠢᠨ ᠪᠠᠷᠠᠭᠤᠨ ᠬᠣᠰᠢᠭᠤ","out":"baγarin baraγun qosiγu"} +{"map":"var-mon-Mong-Latn-vpmc","src":"ᠲᠦᠮᠡᠳ ᠪᠠᠷᠠᠭᠤᠨ ᠬᠣᠰᠢᠭᠤ","out":"tümed baraγun qosiγu"} +{"map":"var-mon-Mong-Latn-vpmc","src":"ᠰᠡᠷᠡᠴᠢ","out":"sereči"} +{"map":"var-mon-Mong-Latn-vpmc","src":"ᠰᠥᠨᠡᠳ ᠵᠡᠭᠦᠨ ᠬᠣᠰᠢᠭᠤ","out":"söned ǰegün qosiγu"} +{"map":"var-zho-Hani-Latn-wd-1979","src":"三塊厝","out":"San-k’uai-ts’o"} diff --git a/scripts/benchmarks/generate.mjs b/scripts/benchmarks/generate.mjs new file mode 100644 index 0000000..24e995c --- /dev/null +++ b/scripts/benchmarks/generate.mjs @@ -0,0 +1,369 @@ +#!/usr/bin/env node +// Orchestrates every benchmark leg SERIALLY (one runtime at a time — +// the parity-README methodology: clean serial runs, nothing else +// executing), aggregates medians, and writes src/data/benchmarks.json. +// +// NEVER hand-edit src/data/benchmarks.json — regenerate it: +// +// npm run generate:benchmarks +// (node scripts/benchmarks/generate.mjs) +// +// Legs (all median-of-3 unless noted): +// corpus parse ruby / ts / py in-process; rs via the iscrs binary +// (wall clock, includes ~20 ms process startup) +// golden replay the interscript-rs golden capture (isc-wf0.jsonl) +// through ruby / ts / py in-process; rs via iscrs +// capture (native single-process capture, includes +// corpus parse) +// fixture the committed fixed input set +// (fixtures/input-set.jsonl) through ruby / ts / py; +// rs throughput derived from its capture leg (rs has +// no batch transliteration CLI) + +import { spawnSync } from "node:child_process" +import { + existsSync, + mkdirSync, + readFileSync, + mkdtempSync, + readdirSync, + rmSync, + writeFileSync, +} from "node:fs" +import os from "node:os" +import { resolve } from "node:path" +import { + FIXTURE, + GOLDEN_JSONL, + LIBS_DIR, + MAPS_DIR, + PY_SRC, + REPO_ROOT, + RUBY_BIN, + RUBY_LIB, + RS_BINARY, + SIBLINGS, + TS_DIST, + headSha, + machineProfile, + median, + requireSiblings, + runtimeVersions, +} from "./config.mjs" + +const RUNS = 3 +const OUT = resolve(REPO_ROOT, "src", "data", "benchmarks.json") + +const log = (...a) => console.log("[bench]", ...a) + +function runAndCapture(cmd, args) { + const t0 = Date.now() + const res = spawnSync(cmd, args, { encoding: "utf8" }) + const wallMs = Date.now() - t0 + if (res.error) throw res.error + return { stdout: res.stdout ?? "", stderr: res.stderr ?? "", wallMs, status: res.status } +} + +/** Parse "… / … in ms …" driver lines. */ +function parseDriverLine(line) { + const m = line.match(/(\w+) (\w+) (\d+)\/(\d+) (?:maps|rows) in ([\d.]+) ms/) + if (!m) return null + return { runtime: m[1], kind: m[2], ok: Number(m[3]), total: Number(m[4]), ms: Number(m[5]) } +} + +function runDriverLegs(name, cmd, args, expected = RUNS) { + log(`${name}: start`) + const { stdout, stderr, wallMs } = runAndCapture(cmd, args) + const lines = stdout.split("\n").filter((l) => l.includes(" in ")) + if (lines.length !== expected) { + console.error(stderr) + throw new Error(`${name}: expected ${expected} result lines, got ${lines.length}`) + } + const parsed = lines.map(parseDriverLine) + if (parsed.some((p) => !p || p.total === 0)) { + console.error(stderr) + throw new Error(`${name}: unparseable driver output: ${lines.join(" | ")}`) + } + const mss = parsed.map((p) => p.ms) + const med = median(mss) + // Every row/map must EXECUTE (an execution error is a harness or + // engine failure — refuse to publish). Output divergence on replay + // legs is a runtime finding, not a harness failure: record it and + // surface it on the page. Parse legs must be corpus-complete. + const failed = Math.min(...parsed.map((p) => p.ok)) + const errMatch = stderr.match(/exec_errors (\d+)/) + const execErrors = errMatch ? Number(errMatch[1]) : 0 + const divMatch = stderr.match(/divergent (\d+)/) + const divergent = divMatch ? Number(divMatch[1]) : 0 + if (failed + execErrors + divergent !== parsed[0].total) { + console.error(stderr) + throw new Error( + `${name}: row accounting mismatch (${failed} matched + ${execErrors} exec errors + ${divergent} divergent != ${parsed[0].total})`, + ) + } + if (execErrors > 0) { + console.error(stderr) + throw new Error(`${name}: ${execErrors} row execution error(s) — refusing to publish`) + } + if (parsed[0].kind === "parse" && failed !== parsed[0].total) { + console.error(stderr) + throw new Error( + `${name}: only ${failed}/${parsed[0].total} maps parsed — fix the leg before publishing numbers`, + ) + } + log( + `${name}: median ${med.toFixed(0)} ms (${parsed.map((p) => `${p.ok}/${p.total}`).join(", ")})${ + divergent > 0 ? ` [${divergent} divergent rows]` : "" + } [${wallMs} ms total]`, + ) + return { + runs: mss, + medianMs: Math.round(med * 10) / 10, + matched: failed, + total: parsed[0].total, + ...(divergent > 0 ? { divergent } : {}), + rowsPerSec: Math.round((parsed[0].total / (med / 1000)) * 10) / 10, + } +} + +function rsParseLeg() { + const results = [] + for (let i = 0; i < RUNS; i++) { + const { stdout, stderr, wallMs, status } = runAndCapture(RS_BINARY(), [ + "parse", + MAPS_DIR(), + "--maps", + MAPS_DIR(), + ]) + if (status !== 0) throw new Error(`rs parse failed: ${stderr}`) + const m = stdout.match(/(\d+)\/(\d+)\/(\d+) files parsed/) + if (!m) throw new Error(`rs parse: unparseable output: ${stdout.trim()}`) + if (Number(m[1]) !== Number(m[3])) { + throw new Error( + `rs parse: only ${m[1]}/${m[3]} maps parsed — refusing to publish partial numbers`, + ) + } + results.push({ wallMs, ok: Number(m[1]), total: Number(m[3]) }) + log(`rs parse run ${i + 1}: ${wallMs} ms (${m[1]}/${m[3]})`) + } + const mss = results.map((r) => r.wallMs) + const med = median(mss) + const total = results[0].total + return { + runs: mss, + medianMs: Math.round(med), + matched: Math.min(...results.map((r) => r.ok)), + total, + perMapMeanMs: Math.round((med / total) * 100) / 100, + note: "wall clock of the iscrs process (includes ~20 ms startup)", + } +} + +function rsCaptureLeg() { + const tmpDir = mkdtempSync(resolve(os.tmpdir(), "wo20-capture-")) + const outFile = resolve(tmpDir, "capture.jsonl") + const runs = [] + let rows = 0 + let maps = 0 + let loadErrors = 0 + for (let i = 0; i < RUNS; i++) { + const { stdout, stderr, wallMs, status } = runAndCapture(RS_BINARY(), [ + "capture", + "--root", + MAPS_DIR(), + "-o", + outFile, + ]) + if (status !== 0) throw new Error(`rs capture failed: ${stderr}`) + const m = stdout.match(/captured (\d+) rows from (\d+) maps \((\d+) load errors\)/) + if (!m) throw new Error(`rs capture: unparseable output: ${stdout.trim()}`) + rows = Number(m[1]) + maps = Number(m[2]) + loadErrors = Number(m[3]) + runs.push(wallMs) + log(`rs capture run ${i + 1}: ${wallMs} ms (${rows} rows)`) + } + rmSync(tmpDir, { recursive: true, force: true }) + const med = median(runs) + return { + runs, + medianMs: Math.round(med), + rows, + maps, + loadErrors, + rowsPerSec: Math.round((rows / (med / 1000)) * 10) / 10, + note: "iscrs capture wall clock: load + transliterate every corpus map's embedded tests in one process (includes corpus parse)", + } +} + +function corpusCount() { + return readdirSync(MAPS_DIR()).filter((f) => f.endsWith(".isc")).length +} + +function goldenRows() { + return readFileSync(GOLDEN_JSONL(), "utf8") + .split("\n") + .filter((l) => l.trim().length > 0).length +} + +function fixtureRows() { + return readFileSync(FIXTURE, "utf8") + .split("\n") + .filter((l) => l.trim().length > 0).length +} + +function main() { + requireSiblings() + if (!existsSync(FIXTURE)) { + throw new Error(`fixture missing (${FIXTURE}) — run: node scripts/benchmarks/make-fixture.mjs`) + } + + const legs = { + // ---- corpus parse (B1) ---- + parse: { + rs: rsParseLeg(), + ruby: runDriverLegs("ruby parse", RUBY_BIN, [ + "-I", + RUBY_LIB(), + resolve(import.meta.dirname, "parse-ruby.rb"), + MAPS_DIR(), + ]), + ts: runDriverLegs("ts parse", process.execPath, [ + resolve(import.meta.dirname, "parse-ts.mjs"), + TS_DIST(), + MAPS_DIR(), + ]), + py: runDriverLegs("py parse", "python3", [ + resolve(import.meta.dirname, "parse-py.py"), + PY_SRC(), + MAPS_DIR(), + LIBS_DIR(), + ]), + }, + // ---- golden replay (B3) ---- + goldenReplay: { + rs: rsCaptureLeg(), + ruby: runDriverLegs("ruby replay golden", RUBY_BIN, [ + "-I", + RUBY_LIB(), + resolve(import.meta.dirname, "replay-ruby.rb"), + MAPS_DIR(), + LIBS_DIR(), + GOLDEN_JSONL(), + ]), + ts: runDriverLegs("ts replay golden", process.execPath, [ + resolve(import.meta.dirname, "replay-ts.mjs"), + TS_DIST(), + MAPS_DIR(), + LIBS_DIR(), + GOLDEN_JSONL(), + ]), + py: runDriverLegs("py replay golden", "python3", [ + resolve(import.meta.dirname, "replay-py.py"), + PY_SRC(), + MAPS_DIR(), + LIBS_DIR(), + GOLDEN_JSONL(), + ]), + }, + // ---- fixed-input-set throughput (B2) ---- + fixtureThroughput: { + ruby: runDriverLegs("ruby replay fixture", RUBY_BIN, [ + "-I", + RUBY_LIB(), + resolve(import.meta.dirname, "replay-ruby.rb"), + MAPS_DIR(), + LIBS_DIR(), + FIXTURE, + ]), + ts: runDriverLegs("ts replay fixture", process.execPath, [ + resolve(import.meta.dirname, "replay-ts.mjs"), + TS_DIST(), + MAPS_DIR(), + LIBS_DIR(), + FIXTURE, + ]), + py: runDriverLegs("py replay fixture", "python3", [ + resolve(import.meta.dirname, "replay-py.py"), + PY_SRC(), + MAPS_DIR(), + LIBS_DIR(), + FIXTURE, + ]), + }, + } + + // rs fixture throughput derives from the capture leg (documented). + legs.fixtureThroughput.rs = { + rowsPerSec: legs.goldenReplay.rs.rowsPerSec, + derivedFrom: "goldenReplay.rs (iscrs capture); rs has no batch transliteration CLI", + } + + for (const leg of Object.values(legs.parse)) { + if (leg.perMapMeanMs === undefined) { + leg.perMapMeanMs = Math.round((leg.medianMs / leg.total) * 100) / 100 + } + } + + const versions = runtimeVersions() + const data = { + schema: 1, + generatedAt: new Date().toISOString(), + methodology: { + runs: RUNS, + aggregation: "median", + serial: true, + note: "clean serial runs — one runtime at a time, nothing else executing (maps/docs/parity/README.md §A.8)", + }, + machine: machineProfile(), + runtimeHeads: { + rs: { + repo: "interscript/interscript-rs", + ref: "main", + sha: headSha(SIBLINGS.rs), + version: versions.rs, + path: SIBLINGS.rs, + }, + ts: { + repo: "interscript/interscript-ts", + ref: "main", + sha: headSha(SIBLINGS.ts), + version: versions.ts, + path: SIBLINGS.ts, + }, + ruby: { + repo: "interscript/interscript-ruby", + ref: "main", + sha: headSha(SIBLINGS.ruby), + version: versions.ruby, + path: SIBLINGS.ruby, + }, + py: { + repo: "interscript/interscript-ruby (py ISC engine tree)", + ref: "wo17/py-override-placement", + sha: headSha(SIBLINGS.py), + version: versions.py, + path: SIBLINGS.py, + note: "the py ISC engine ships on this unmerged branch of the interscript-ruby repo; interscript-py main still carries the legacy .imp engine and cannot run the ISC corpus", + }, + }, + corpus: { + maps: corpusCount(), + goldenRows: goldenRows(), + fixtureRows: fixtureRows(), + sha: headSha(SIBLINGS.maps), + }, + ...legs, + } + + mkdirSync(resolve(REPO_ROOT, "src", "data"), { recursive: true }) + writeFileSync(OUT, JSON.stringify(data, null, 2) + "\n") + console.log(`[bench] wrote ${OUT}`) +} + +try { + main() +} catch (e) { + console.error("[bench] FAILED:", e.message) + process.exit(1) +} diff --git a/scripts/benchmarks/make-fixture.mjs b/scripts/benchmarks/make-fixture.mjs new file mode 100644 index 0000000..0192a14 --- /dev/null +++ b/scripts/benchmarks/make-fixture.mjs @@ -0,0 +1,33 @@ +#!/usr/bin/env node +// Regenerate the transliteration benchmark fixture: a deterministic +// fixed input set sampled from the interscript-rs golden capture +// (every Nth row). The fixture is committed and stays FIXED across +// benchmark runs so the throughput series is comparable over time even +// as the golden itself evolves. +// +// Usage: node make-fixture.mjs [--stride 25] +// Writes: fixtures/input-set.jsonl (do not hand-edit) + +import { createHash } from "node:crypto" +import { readFileSync, writeFileSync } from "node:fs" +import { GOLDEN_JSONL, FIXTURE } from "./config.mjs" + +const stride = (() => { + const i = process.argv.indexOf("--stride") + return i === -1 ? 25 : Number(process.argv[i + 1]) +})() + +const lines = readFileSync(GOLDEN_JSONL(), "utf8") + .split("\n") + .filter((l) => l.trim().length > 0) +const sampled = lines.filter((_, i) => i % stride === 0) + +const sha = createHash("sha256").update(readFileSync(GOLDEN_JSONL())).digest("hex") + +// Pure jsonl (no comment header) so every replay driver can consume it +// directly; provenance lives in README.md and the generated +// benchmarks.json. +writeFileSync(FIXTURE, sampled.join("\n") + "\n") +console.log( + `fixture: ${sampled.length} rows (every ${stride}th of ${lines.length} golden rows, golden sha256 ${sha.slice(0, 16)}…) -> ${FIXTURE}`, +) diff --git a/scripts/benchmarks/parse-py.py b/scripts/benchmarks/parse-py.py new file mode 100644 index 0000000..188bf8c --- /dev/null +++ b/scripts/benchmarks/parse-py.py @@ -0,0 +1,57 @@ +#!/usr/bin/env python +"""Corpus parse timing (py leg): parse_isc over every corpus .isc with +a dependency resolver over maps/ + libs/, in-process, RUNS runs. +Methodology follows maps/docs/parity/README.md §A.8 (median-of-3, +clean serial runs). + +Usage: python3 parse-py.py + +(py's bare parse entry cannot take the corpus alone — see parity README +G12 — so this measures the corpus-complete form, same as the audit.) +""" + +import sys +import time +from pathlib import Path + +RUNS = 3 + +py_src, maps_dir, libs_dir = sys.argv[1], sys.argv[2], sys.argv[3] +sys.path.insert(0, py_src) + +from interscript import parse_isc # noqa: E402 + +d = Path(maps_dir) +libd = Path(libs_dir) +files = sorted(d.glob("*.isc")) +assert files, f"no .isc files under {maps_dir}" + +_cache: dict[str, object] = {} + + +def resolve(target: str): + """Dependency resolver over the corpus + libs dirs (mirrors the + load-path resolution ruby/rs do natively).""" + if target in _cache: + return _cache[target] + for base in (d, libd): + p = base / f"{target}.isc" + if p.exists(): + doc = parse_isc(p.read_text(encoding="utf-8"), p.name, resolve_dependency=resolve) + _cache[target] = doc + return doc + return None + + +for run in range(RUNS): + _cache.clear() + t0 = time.perf_counter() + ok = 0 + for f in files: + try: + parse_isc(f.read_text(encoding="utf-8"), f.name, resolve_dependency=resolve) + ok += 1 + except Exception as e: # noqa: BLE001 - report and continue + print(f"FAIL {f.name}: {str(e).splitlines()[0]}", file=sys.stderr) + t1 = time.perf_counter() + print(f"py parse {ok}/{len(files)} maps in {(t1 - t0) * 1000:.1f} ms") diff --git a/scripts/benchmarks/parse-ruby.rb b/scripts/benchmarks/parse-ruby.rb new file mode 100644 index 0000000..422664b --- /dev/null +++ b/scripts/benchmarks/parse-ruby.rb @@ -0,0 +1,33 @@ +#!/usr/bin/env ruby +# frozen_string_literal: true + +# Corpus parse timing (ruby leg): Interscript::Interpreter.parse_isc over +# every corpus .isc, in-process, RUNS runs. Methodology follows +# maps/docs/parity/README.md §A.8 (median-of-3, clean serial runs). +# +# The orchestrator invokes this as: +# ruby -I parse-ruby.rb +# so the engine under test is the sibling interscript-ruby checkout. + +maps_dir = ARGV[0] +RUNS = 3 + +require "interscript" + +files = Dir["#{maps_dir}/*.isc"].sort +abort "no .isc files under #{maps_dir}" if files.empty? + +RUNS.times do + ok = 0 + t0 = Process.clock_gettime(Process::CLOCK_MONOTONIC) + files.each do |f| + begin + Interscript::Interpreter.parse_isc(f) + ok += 1 + rescue StandardError => e + warn "FAIL #{File.basename(f)}: #{e.message.lines.first&.chomp}" + end + end + t1 = Process.clock_gettime(Process::CLOCK_MONOTONIC) + puts format("ruby parse %d/%d maps in %.1f ms", ok, files.size, (t1 - t0) * 1000) +end diff --git a/scripts/benchmarks/parse-ts.mjs b/scripts/benchmarks/parse-ts.mjs new file mode 100644 index 0000000..a3ef665 --- /dev/null +++ b/scripts/benchmarks/parse-ts.mjs @@ -0,0 +1,34 @@ +#!/usr/bin/env node +// Corpus parse timing (ts leg): parseIsc over every corpus .isc, +// in-process, RUNS runs. Methodology follows maps/docs/parity/README.md +// §A.8 (median-of-3, clean serial runs). +// +// Usage: node parse-ts.mjs + +import { readFileSync, readdirSync } from "node:fs" +import { resolve } from "node:path" + +const [distDir, mapsDir] = process.argv.slice(2) +const RUNS = 3 + +const { parseIsc } = await import(resolve(distDir, "isc", "index.js")) + +const files = readdirSync(mapsDir) + .filter((f) => f.endsWith(".isc")) + .sort() +if (files.length === 0) throw new Error(`no .isc files under ${mapsDir}`) + +for (let run = 0; run < RUNS; run++) { + const t0 = performance.now() + let ok = 0 + for (const f of files) { + try { + parseIsc(readFileSync(resolve(mapsDir, f), "utf8"), f) + ok++ + } catch (e) { + console.error(`FAIL ${f}: ${String(e.message).split("\n")[0]}`) + } + } + const t1 = performance.now() + console.log(`ts parse ${ok}/${files.length} maps in ${(t1 - t0).toFixed(1)} ms`) +} diff --git a/scripts/benchmarks/replay-py.py b/scripts/benchmarks/replay-py.py new file mode 100644 index 0000000..8514f59 --- /dev/null +++ b/scripts/benchmarks/replay-py.py @@ -0,0 +1,101 @@ +#!/usr/bin/env python +"""Transliteration replay (py leg): execute every row of a jsonl row +set ({"map", "src", "out"}) through the engine, in-process, RUNS runs. +Corpus parse+compile is setup (unmeasured); only the transliteration +loop is timed. Reports rows/sec and the exact-match count. + +Usage: python3 replay-py.py + +Protocol mirrors the py golden additivity test (tests/test_golden_capture.py): +parse + compile the whole corpus in memory, resolve dependencies and +WF-1 ruleuset expansion lazily against the same corpus. +""" + +import json +import sys +import time +from pathlib import Path + +RUNS = 3 + +py_src, maps_dir, libs_dir, rows_path = sys.argv[1], sys.argv[2], sys.argv[3], sys.argv[4] +sys.path.insert(0, py_src) + +from interscript.executor import execute_stage # noqa: E402 +from interscript.isc import isc_to_compiled_map, parse_isc # noqa: E402 + +rows = [ + json.loads(line) + for line in Path(rows_path).read_text(encoding="utf-8").splitlines() + if line.strip() +] +assert rows, f"no rows in {rows_path}" + +d = Path(maps_dir) +libd = Path(libs_dir) + +# Setup (unmeasured): parse + compile every corpus .isc; dependencies +# resolve lazily against the same corpus (libs first — system maps +# declare dependencies on the libraries). +docs: dict[str, object] = {} + + +def resolve_dependency(target: str): + return docs.get(target) + + +for directory in (libd, d): + if not directory.is_dir(): + continue + for path in sorted(directory.glob("*.isc")): + docs[path.stem] = parse_isc( + path.read_text(encoding="utf-8"), + filename=str(path), + resolve_dependency=resolve_dependency, + ) +compiled = {stem: isc_to_compiled_map(doc) for stem, doc in docs.items()} + + +class _Resolver: + """MapResolver over the in-memory corpus (the MapLoader protocol).""" + + def load(self, system_code: str): + cm = compiled.get(system_code) + if cm is None: + raise KeyError(system_code) + return cm + + +resolver = _Resolver() + +# Unmeasured warmup pass (first-touch execution paths settle here). +for row in rows: + try: + execute_stage(compiled[row["map"]], "main", row["src"], resolver) + except Exception: # noqa: BLE001 + continue + +for run in range(RUNS): + matched = 0 + errors = 0 + t0 = time.perf_counter() + for row in rows: + try: + cm = compiled[row["map"]] + out = execute_stage(cm, "main", row["src"], resolver, None) + except Exception: # noqa: BLE001 - unexecutable rows still cost the attempt + errors += 1 + continue + if out == row["out"]: + matched += 1 + t1 = time.perf_counter() + ms = (t1 - t0) * 1000 + print( + f"py replay {matched}/{len(rows)} rows in {ms:.1f} ms ({len(rows) / (ms / 1000):.0f} rows/s)" + ) + divergent = len(rows) - matched - errors + if divergent or errors: + print( + f"divergent {divergent} exec_errors {errors}", + file=sys.stderr, + ) diff --git a/scripts/benchmarks/replay-ruby.rb b/scripts/benchmarks/replay-ruby.rb new file mode 100644 index 0000000..46dc334 --- /dev/null +++ b/scripts/benchmarks/replay-ruby.rb @@ -0,0 +1,64 @@ +#!/usr/bin/env ruby +# frozen_string_literal: true + +# Transliteration replay (ruby leg): execute every row of a jsonl +# row set ({map, src, out}) through the engine, in-process. One +# unmeasured warmup pass, then RUNS measured passes; only the +# transliteration loop is timed. Reports rows/sec and the exact-match +# count for verification. +# +# Usage: ruby -I replay-ruby.rb + +maps_dir, libs_dir, rows_path = ARGV[0], ARGV[1], ARGV[2] +RUNS = 3 + +require "interscript" +require "json" + +rows = File.readlines(rows_path).filter_map do |l| + l.strip! + l.empty? ? nil : JSON.parse(l) +end +abort "no rows in #{rows_path}" if rows.empty? + +Interscript.load_path.unshift(maps_dir) if File.directory?(maps_dir) +Interscript.load_path.unshift(libs_dir) if File.directory?(libs_dir) + +# Setup (unmeasured): load each distinct map once. +interpreters = {} +rows.each do |row| + next if interpreters.key?(row["map"]) + interpreters[row["map"]] = Interscript::Interpreter.call(row["map"]) +end + +# Unmeasured warmup pass (lazy loads settle on the first full pass). +rows.each do |row| + begin + interpreters[row["map"]].call(row["src"], :main) + rescue StandardError + # unexecutable rows are simply non-matching + end +end + +RUNS.times do + matched = 0 + errors = 0 + t0 = Process.clock_gettime(Process::CLOCK_MONOTONIC) + rows.each do |row| + begin + out = interpreters[row["map"]].call(row["src"], :main) + rescue StandardError + errors += 1 + next + end + matched += 1 if out == row["out"] + end + t1 = Process.clock_gettime(Process::CLOCK_MONOTONIC) + ms = (t1 - t0) * 1000 + puts format( + "ruby replay %d/%d rows in %.1f ms (%.0f rows/s)", + matched, rows.size, ms, rows.size / (ms / 1000.0), + ) + divergent = rows.size - matched - errors + warn "divergent #{divergent} exec_errors #{errors}" if divergent.positive? || errors.positive? +end diff --git a/scripts/benchmarks/replay-ts.mjs b/scripts/benchmarks/replay-ts.mjs new file mode 100644 index 0000000..9b42206 --- /dev/null +++ b/scripts/benchmarks/replay-ts.mjs @@ -0,0 +1,69 @@ +#!/usr/bin/env node +// Transliteration replay (ts leg): execute every row of a jsonl row +// set ({map, src, out}) through the engine, in-process, RUNS runs. +// Corpus preload is setup (unmeasured); only the transliteration loop +// is timed. Reports rows/sec and the exact-match count. +// +// Usage: node replay-ts.mjs + +import { readFileSync, readdirSync } from "node:fs" +import { resolve } from "node:path" + +const [distDir, mapsDir, libsDir, rowsPath] = process.argv.slice(2) +const RUNS = 3 + +const { configure, transliterate } = await import(resolve(distDir, "index.js")) +const { iscBundledStrategy } = await import(resolve(distDir, "isc", "loader.js")) + +const rows = readFileSync(rowsPath, "utf8") + .split("\n") + .filter((l) => l.trim().length > 0) + .map((l) => JSON.parse(l)) +if (rows.length === 0) throw new Error(`no rows in ${rowsPath}`) + +// Setup (unmeasured): preload the corpus into the bundled strategy. +const sources = {} +for (const dir of [libsDir, mapsDir]) { + try { + for (const f of readdirSync(dir).filter((f) => f.endsWith(".isc"))) { + sources[f.replace(/\.isc$/, "")] = readFileSync(resolve(dir, f), "utf8") + } + } catch { + // absent dir (no libs) — skip + } +} +configure({ strategies: [iscBundledStrategy(sources)] }) + +// Unmeasured warmup pass (per-map lazy compilation settles here). +for (const row of rows) { + try { + transliterate(row.map, row.src) + } catch { + // unexecutable rows are simply non-matching + } +} + +for (let run = 0; run < RUNS; run++) { + let matched = 0 + let errors = 0 + const t0 = performance.now() + for (const row of rows) { + let got + try { + got = transliterate(row.map, row.src) + } catch { + errors++ + continue + } + if (got === row.out) matched++ + } + const t1 = performance.now() + const ms = t1 - t0 + console.log( + `ts replay ${matched}/${rows.length} rows in ${ms.toFixed(1)} ms (${Math.round(rows.length / (ms / 1000))} rows/s)`, + ) + const divergent = rows.length - matched - errors + if (divergent > 0 || errors > 0) { + console.error(`divergent ${divergent} exec_errors ${errors}`) + } +} diff --git a/src/data/benchmarks.json b/src/data/benchmarks.json new file mode 100644 index 0000000..89f196b --- /dev/null +++ b/src/data/benchmarks.json @@ -0,0 +1,197 @@ +{ + "schema": 1, + "generatedAt": "2026-11-16T15:00:31.525Z", + "methodology": { + "runs": 3, + "aggregation": "median", + "serial": true, + "note": "clean serial runs — one runtime at a time, nothing else executing (maps/docs/parity/README.md §A.8)" + }, + "machine": { + "os": "Darwin 23.1.0", + "arch": "arm64", + "cpuModel": "Apple M1 Max", + "cores": 10, + "memoryGb": 64, + "node": "v24.14.0", + "toolchains": { + "ruby": "3.4.8", + "python": "3.10.5" + } + }, + "runtimeHeads": { + "rs": { + "repo": "interscript/interscript-rs", + "ref": "main", + "sha": "74b4b8d071ff0e3c10159da2832b7fb76b92f8e2", + "version": "0.3.2", + "path": "/Users/mulgogi/src/interscript/wo20-bench/interscript-rs" + }, + "ts": { + "repo": "interscript/interscript-ts", + "ref": "main", + "sha": "b74cfdaf56b4a726ad98abf40ccccbf3d486f418", + "version": "5.10.0", + "path": "/Users/mulgogi/src/interscript/wo20-bench/interscript-ts" + }, + "ruby": { + "repo": "interscript/interscript-ruby", + "ref": "main", + "sha": "4c47eb52db75ff459ecb599d3386748f31bd6c93", + "version": "3.7.2", + "path": "/Users/mulgogi/src/interscript/wo20-bench/interscript-ruby" + }, + "py": { + "repo": "interscript/interscript-ruby (py ISC engine tree)", + "ref": "wo17/py-override-placement", + "sha": "5781a996fbb20450661ef44d5fbdf251da0bc0dc", + "version": "0.1.0", + "path": "/Users/mulgogi/src/interscript/wo20-bench/interscript-py-isc", + "note": "the py ISC engine ships on this unmerged branch of the interscript-ruby repo; interscript-py main still carries the legacy .imp engine and cannot run the ISC corpus" + } + }, + "corpus": { + "maps": 428, + "goldenRows": 12839, + "fixtureRows": 514, + "sha": "c55bc5c2127f4796418391917a4dfaf75c7b4f88" + }, + "parse": { + "rs": { + "runs": [ + 35012, + 26366, + 25293 + ], + "medianMs": 26366, + "matched": 428, + "total": 428, + "perMapMeanMs": 61.6, + "note": "wall clock of the iscrs process (includes ~20 ms startup)" + }, + "ruby": { + "runs": [ + 167427.6, + 178408.4, + 149516.8 + ], + "medianMs": 167427.6, + "matched": 428, + "total": 428, + "rowsPerSec": 2.6, + "perMapMeanMs": 391.19 + }, + "ts": { + "runs": [ + 16106.3, + 15026.8, + 15267.8 + ], + "medianMs": 15267.8, + "matched": 428, + "total": 428, + "rowsPerSec": 28, + "perMapMeanMs": 35.67 + }, + "py": { + "runs": [ + 5077.4, + 4677.8, + 4503.5 + ], + "medianMs": 4677.8, + "matched": 428, + "total": 428, + "rowsPerSec": 91.5, + "perMapMeanMs": 10.93 + } + }, + "goldenReplay": { + "rs": { + "runs": [ + 66592, + 66448, + 66568 + ], + "medianMs": 66568, + "rows": 12839, + "maps": 428, + "loadErrors": 1, + "rowsPerSec": 192.9, + "note": "iscrs capture wall clock: load + transliterate every corpus map's embedded tests in one process (includes corpus parse)" + }, + "ruby": { + "runs": [ + 7604.8, + 7685.4, + 7590.9 + ], + "medianMs": 7604.8, + "matched": 12839, + "total": 12839, + "rowsPerSec": 1688.3 + }, + "ts": { + "runs": [ + 7843, + 7105.1, + 6796.9 + ], + "medianMs": 7105.1, + "matched": 12839, + "total": 12839, + "rowsPerSec": 1807 + }, + "py": { + "runs": [ + 61664.2, + 61842.7, + 86985.9 + ], + "medianMs": 61842.7, + "matched": 12836, + "total": 12839, + "divergent": 3, + "rowsPerSec": 207.6 + } + }, + "fixtureThroughput": { + "ruby": { + "runs": [ + 218.5, + 234.6, + 240.3 + ], + "medianMs": 234.6, + "matched": 514, + "total": 514, + "rowsPerSec": 2191 + }, + "ts": { + "runs": [ + 751, + 229.9, + 228.9 + ], + "medianMs": 229.9, + "matched": 514, + "total": 514, + "rowsPerSec": 2235.8 + }, + "py": { + "runs": [ + 7046.5, + 6855.7, + 6929.9 + ], + "medianMs": 6929.9, + "matched": 514, + "total": 514, + "rowsPerSec": 74.2 + }, + "rs": { + "rowsPerSec": 192.9, + "derivedFrom": "goldenReplay.rs (iscrs capture); rs has no batch transliteration CLI" + } + } +} diff --git a/src/layouts/Base.astro b/src/layouts/Base.astro index 8c47a26..0df45de 100644 --- a/src/layouts/Base.astro +++ b/src/layouts/Base.astro @@ -46,6 +46,7 @@ const navItems: NavItem[] = [ children: [ { href: "/api", label: "API" }, { href: "https://api.interscript.org/docs", label: "API reference" }, + { href: "/benchmarks", label: "Benchmarks" }, { href: "/status", label: "Status" }, ], }, @@ -88,6 +89,7 @@ const drawerGroups: Array<{ label: string; links: NavLink[] }> = [ links: [ { href: "/api", label: "API" }, { href: "https://api.interscript.org/docs", label: "API reference" }, + { href: "/benchmarks", label: "Benchmarks" }, { href: "/status", label: "Status" }, ], }, diff --git a/src/pages/benchmarks.astro b/src/pages/benchmarks.astro new file mode 100644 index 0000000..bdf0c55 --- /dev/null +++ b/src/pages/benchmarks.astro @@ -0,0 +1,449 @@ +--- +import Base from "../layouts/Base.astro" +import data from "../data/benchmarks.json" with { type: "json" } + +interface DriverLeg { + runs: number[] + medianMs: number + matched: number + total: number + divergent?: number + perMapMeanMs?: number + rowsPerSec?: number + note?: string +} +interface CaptureLeg extends DriverLeg { + rows: number + maps: number + loadErrors: number +} +interface DerivedLeg { + rowsPerSec: number + derivedFrom: string +} +interface Head { + repo: string + ref: string + sha: string | null + version: string | null + note?: string +} + +interface BenchData { + generatedAt: string + methodology: { runs: number; aggregation: string; serial: boolean; note: string } + machine: { + os: string + arch: string + cpuModel: string + cores: number + memoryGb: number + node: string + toolchains: { ruby: string | null; python: string | null } + } + runtimeHeads: Record + corpus: { maps: number; goldenRows: number; fixtureRows: number; sha: string | null } + parse: Record + goldenReplay: Record + fixtureThroughput: Record +} + +const d = data as unknown as BenchData + +const ms = (v: number): string => `${Math.round(v).toLocaleString("en-US")} ms` +const secs = (v: number): string => `${(v / 1000).toFixed(v >= 10000 ? 1 : 2)} s` +const both = (v: number): string => `${ms(v)} (${secs(v)})` +const shortSha = (sha: string | null): string => (sha ? sha.slice(0, 10) : "—") +const headOf = (key: string): Head => d.runtimeHeads[key]! + +const parseOrder = ["ts", "ruby", "py", "rs"] as const +const replayOrder = ["ts", "ruby", "py"] as const + +const rsCapture = d.goldenReplay.rs as CaptureLeg +const rsTranslitOnly = rsCapture.medianMs - d.parse.rs!.medianMs + +// The audit-day baseline is frozen by design: these are the audited +// clean serial series from interscript/maps docs/parity/README.md §A.8 +// (2026-11-13), quoted verbatim for comparability. Current-HEAD numbers +// above come from the generated data file only. +const baseline = [ + { + runtime: "ts (parseIsc)", + runs: "16,742.8 / 15,826.8 / 15,986.5", + median: 15986, + perMap: 37, + }, + { + runtime: "py (parse_isc + resolver)", + runs: "77,839.3 / 80,709.3 / 81,024.7", + median: 80709, + perMap: 189, + }, + { + runtime: "rs (iscrs parse, release, wall)", + runs: "81,410 / 79,220 / 77,490", + median: 79220, + perMap: 185, + }, + { + runtime: "ruby (Interpreter.parse_isc)", + runs: "186,029.0 / 156,782.2 / 161,449.9", + median: 161450, + perMap: 377, + }, +] +--- + + +
+
+

Benchmarks

+

Measured, not claimed.

+

+ Corpus parse, golden replay, and fixed-input transliteration throughput for the four + Interscript runtimes, generated by checked-in scripts — never hand-edited. The parity + audit-day table is kept frozen below as the baseline; this page tracks current HEAD. +

+
+
+ +
+
+

+ Generated {d.generatedAt} by scripts/benchmarks/generate.mjs: + {d.methodology.runs} runs per leg, median aggregation, strictly serial (one runtime at a + time, nothing else executing). The TS leg reads a built dist, the rs leg reads + the release iscrs binary, and the ruby/py legs run in-process against sibling + checkouts of the four runtime repos and the map corpus — every tree's exact commit is + recorded below. +

+ + + + + + + + + + + + {parseOrder.map((key) => { + const h = headOf(key) + return ( + + + + + + + ) + })} + +
RuntimeRepo / refCommitVersion
+ {key} + + {h.repo} @{h.ref} + + {shortSha(h.sha)} + {h.version ?? "—"}
+ {headOf("py").note &&

{headOf("py").note}

} + +

+ Machine: {d.machine.cpuModel}, {d.machine.cores} cores, {d.machine.memoryGb} GB,{" "} + {d.machine.os} ({d.machine.arch}); node {d.machine.node}, ruby{" "} + {d.machine.toolchains.ruby ?? "?"}, python {d.machine.toolchains.python ?? "?"}. Corpus:{" "} + {d.corpus.maps} maps (maps@{shortSha(d.corpus.sha)}); golden capture {d.corpus.goldenRows}{" "} + rows; fixed input set {d.corpus.fixtureRows} rows. +

+
+ +
+
+

Corpus parse

+

Parse every corpus map, median of {d.methodology.runs}

+
+
+ + + + + + + + + + + + {parseOrder.map((key) => { + const leg = d.parse[key]! + return ( + + + + + + + + ) + })} + +
RuntimeMedianPer-map meanParsedRuns
{key}{both(leg.medianMs)}~{leg.perMapMeanMs} ms + {leg.matched}/{leg.total} + {leg.runs.map((r) => Math.round(r)).toLocaleString("en-US")}
+

{d.parse.rs!.note}

+
+
+ +
+
+

Golden replay

+

Replay the golden capture end to end

+
+
+

+ The cross-runtime contract is the RS golden capture ( + interscript-rs tests/golden/isc-wf0.jsonl, {d.corpus.goldenRows} rows). TS, + ruby, and py replay it in-process (1 unmeasured warmup pass, then {d.methodology.runs}{" "} + measured passes); rs runs its native single-process capture over the corpus' embedded + tests, which includes the parse. +

+ + + + + + + + + + + {replayOrder.map((key) => { + const leg = d.goldenReplay[key]! + return ( + + + + + + + ) + })} + + + + + + + +
RuntimeMedianByte-exactNote
{key}{both(leg.medianMs)} + {leg.matched.toLocaleString("en-US")}/{leg.total.toLocaleString("en-US")} + {leg.divergent ? ( + ({leg.divergent} diverge) + ) : null} + in-process jsonl replay
rs{both(rsCapture.medianMs)}{rsCapture.rows} rows captured + iscrs capture wall; translit-only ≈ {both(rsTranslitOnly)} after + subtracting the parse median +
+ {replayOrder.some((key) => (d.goldenReplay[key]?.divergent ?? 0) > 0) && ( +

+ Divergent rows are golden output mismatches (deterministic across passes; an execution + error would fail the run outright rather than be reported). The three current py + divergences are the Ў rows of the three thin ALA-LC Belarusian maps ( + gki-bel, mvd-bel, odni-bel) — the newest corpus + additions, whose exhaustive per-row tests ts and ruby replay byte-exact. +

+ )} +

+ The byte-exact columns are a sanity signal, not the parity gate — conformance is enforced + in each runtime's own CI (rs golden_capture, ts{" "} + test/golden-isc-wf0.test.ts, py test_golden_capture.py). +

+
+
+ +
+
+

Transliteration throughput

+

+ Fixed input set ({d.corpus.fixtureRows} rows), median of {d.methodology.runs} +

+
+
+

+ The input set is committed at scripts/benchmarks/fixtures/input-set.jsonl — + every 25th row of the golden capture, sampled once and then frozen so the series stays + comparable as the golden evolves. +

+ + + + + + + + + + + {replayOrder.map((key) => { + const leg = d.fixtureThroughput[key] as DriverLeg + return ( + + + + + + + ) + })} + + + + + + + +
Runtimerows/sms/rowSource
{key}{Math.round(leg.rowsPerSec!).toLocaleString("en-US")}{(1000 / leg.rowsPerSec!).toFixed(2)}in-process, fixture replay
rs + {Math.round((d.fixtureThroughput.rs as DerivedLeg).rowsPerSec).toLocaleString( + "en-US", + )} + + {(1000 / (d.fixtureThroughput.rs as DerivedLeg).rowsPerSec).toFixed(2)} + derived from the capture leg — rs has no batch CLI
+
+
+ +
+
+

Audit-day baseline (frozen)

+

428-map corpus parse, 2026-11-13 audit

+
+
+

+ Quoted from the{" "} + + ISC runtime feature-parity audit + {" "} + (§A.8, macOS 14, apple-silicon, clean serial runs). This table is the audit-day baseline + and is kept unchanged; the tables above track current HEAD and are regenerated by script. +

+ + + + + + + + + + + {baseline.map((row) => ( + + + + + + + ))} + +
RuntimeRuns (ms)MedianPer-map mean
{row.runtime}{row.runs}{both(row.median)}~{row.perMap} ms
+

+ Audit-day postscript (WO18): py's generated parser was later closure-compiled — controlled + before/after showed roughly 78 s down to about 22 s per corpus pass, byte-identical + output. The py row above reflects the pre-closure audit run. +

+
+
+ +
+
+

Reproduce

+

Exact commands

+
+
+

+ The scripts require sibling checkouts of the benchmarked trees — the map corpus ( + maps), interscript-rs (with a release build:{" "} + cargo build --release), interscript-ts (with a built{" "} + dist/), interscript-ruby, and the py ISC engine tree (the{" "} + wo17/py-override-placement branch of the interscript-ruby repo, whose Python + package lives at interscript-py/ inside it). Override any location with the{" "} + INTERSCRIPT_MAPS, INTERSCRIPT_RS, INTERSCRIPT_TS,{" "} + INTERSCRIPT_RUBY, and INTERSCRIPT_PY environment variables. +

+
{`# one-time: freeze the fixed input set from the rs golden capture
+node scripts/benchmarks/make-fixture.mjs
+
+# regenerate every number on this page (clean serial runs, ~30-60 min)
+node scripts/benchmarks/generate.mjs
+
+# the output lands in src/data/benchmarks.json — never hand-edit it;
+# commit the regeneration with the runtime changes it measures`}
+

+ Methodology follows the parity audit's timing protocol ( + maps/docs/parity/README.md §A.8): median-of-3, in-process timing for the + interpreted runtimes, wall clock for the rs CLI legs, strictly serial. +

+
+
+
+ + +