Drop substantivized-adjective false nouns via manual_reject.txt
build / dawg (pull_request) Successful in 1m33s
build / dawg (pull_request) Successful in 1m33s
OpenCorpora/libmorph hand a noun reading to Stage 2 above the РАН note, so substantivized-adjective false nouns a dictionary misreads (нёбный, акцизный, велярный, …) reached scrabble.txt with no veto path — the earlier abbreviation filter only carved out Abbr+Fixd. ru_stage2.py now subtracts sources/scrabble_ru/manual_reject.txt last, after every admission path (OC seed / libmorph / note / manual_confirm / variant), mirroring manual_confirm.txt. The list seeds 62 hand-reviewed words — 43 pure adjectives plus 19 marginal (slang/archaic/jargon) substantivizations; genuine substantivized nouns (больной, знакомый, учёный, участковый, …) stay. scrabble.txt -62 (83206->83144); erudit.txt re-folded -62. The DAWGs are gitignored and rebuild from these lists in CI.
This commit is contained in:
+9
-1
@@ -353,7 +353,15 @@ def build():
|
||||
fate[y] = f"scrabble: вариант от «{x}» (через «и»)"
|
||||
changed = True
|
||||
|
||||
undefined = [w for w in amb if w not in scrabble]
|
||||
# Manual rejections: words the maintainer vetoed — substantivized-adjective false nouns
|
||||
# a dictionary misreads as nouns (нёбный, акцизный, …). Subtracted last, so it overrides
|
||||
# every admission path above (OC seed / libmorph / note / manual_confirm / variant).
|
||||
reject = {w for w in load(os.path.join(OUT_DIR, "manual_reject.txt")) if cyr_ok(w)}
|
||||
scrabble -= reject
|
||||
for w in reject:
|
||||
fate[w] = "отброшено: ручной запрет (manual_reject.txt)"
|
||||
|
||||
undefined = [w for w in amb if w not in scrabble and w not in reject]
|
||||
return {
|
||||
"oc": oc, "scrabble": scrabble, "undefined": undefined,
|
||||
"adjectives": adj, "verbs": verb, "singulars": ed_nouns,
|
||||
|
||||
Reference in New Issue
Block a user