Ilia Denisov
6b8b176f82
build / dawg (pull_request) Successful in 2m45s
OpenCorpora tags indeclinable abbreviations as common nouns (Abbr+Fixd), and Stage 2 seeded the result with its whole noun lexicon, so non-words leaked into scrabble.txt: ндс, ст, ср, кпд, чп, гибдд, днк, … ru_stage2.py now drops Abbr+Fixd nouns from the OpenCorpora seed and lets the orthographic dictionary decide instead: a lowercase РАН headword whose note is a noun is kept (the lexicalised сельпо, под, ска, роно, врио, тв, фио, суперэвм), everything else is dropped. Function words (CONJ/PRCL, e.g. зато) and OpenCorpora inflected forms (ан = род. мн. от «ана»; proper «Ан») are excluded too. --trace WORD now prints a detailed per-signal audit (all.txt, OpenCorpora POS / Abbr / Fixd / CONJ/PRCL, libmorph, РАН note + classify, outcome) for auditing a word or repeating the analysis; tools/README.md documents the rule and method. Net: 179 words removed from scrabble.txt (83385 -> 83206) and erudit.txt (83343 -> 83164); verified to remove exactly those 179 and add none. DAWGs rebuild clean.
scrabble_ru source
scrabble.txt — Russian Scrabble common nouns (nominative singular), produced by the prep
pipeline under ../../tools/ from the Russian academic orthographic
dictionary, cross-checked against OpenCorpora and libmorph. manual_confirm.txt holds the
hand-reviewed additions the pipeline merges in. Built to dawg/ru_scrabble.dawg (make dawg-ru).
The pdftotext source of truth (orfo_dict_2025.txt) and the Stage-1 base (all.txt) are
committed here; only the debug dumps (undefined.txt, adjectives.txt, verbs.txt,
singulars.txt, fate.tsv) are regenerated locally and git-ignored.