Ilia Denisov
7f8165f16d
build / dawg (pull_request) Successful in 24s
Remove the 11 obscene nouns built on the хуй/еб·ёб/пизд/бляд roots (ахуй, блядь, выблядок, ебальник, еблан, охуение, пизда, пиздец, пиздобол, хуй, хуйня) from the Russian Scrabble/Эрудит dictionary. These are morphologically valid common nouns, so the pipeline admitted them like any other word — OpenCorpora's tagset exposes no obscenity grammeme to filter on. They are vetoed as policy via manual_reject.txt, which is subtracted last in ru_stage2.build(), so no pipeline logic changes: scrabble.txt is the deterministic result of that subtraction and erudit.txt is its Ё→Е fold, regenerated with tools/fold_yo.py. The coarser-but-not-mat муд* (мудак, мудила) and legitimate homographs (очко, сука, моча, дрочёна) are deliberately kept. scrabble.txt 83027 -> 83016, erudit.txt 82985 -> 82974.
scrabble_ru source
scrabble.txt — Russian Scrabble common nouns (nominative singular), produced by the prep
pipeline under ../../tools/ from the Russian academic orthographic
dictionary, cross-checked against OpenCorpora and libmorph. manual_confirm.txt holds the
hand-reviewed additions the pipeline merges in. Built to dawg/ru_scrabble.dawg (make dawg-ru).
The pdftotext source of truth (orfo_dict_2025.txt) and the Stage-1 base (all.txt) are
committed here; only the debug dumps (undefined.txt, adjectives.txt, verbs.txt,
singulars.txt, fate.tsv) are regenerated locally and git-ignored.