-
-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
not only Eng support #89
Comments
Hey @smir-ant, can you provide an simple use case so I can run some test around here? when you say auto-label/src/scraper/text.ts Line 44 in 5fc2b85
|
@Renato66 oh, sry if the issue markdown has labelsSynonyms, then there is no problem. as long as we're not talking about Russian symbols. for example, if "2/5" is specified in labelsSynonyms: ["плохо"], then the label was not set, however, if the trigger is "bad" instead "плохо", then the label is put down as it should be if I'm not mistaken... of course, since I tried to use it a week ago and have completely forgotten :( |
@Renato66, doing this change will support the Russian symbols and anyone that uses Unicode characters: - (?<label>(\s*\w.+|\n)*?)\s*
+ (?<label>(\s*\p{L}.+|\n)*?)\s* \wMatches any alphanumeric character (A-Z, a-z, 0-9) and the underscore (_). \p{L}It uses the Unicode property to match any letter from any alphabet. This includes all uppercase and lowercase letters from all alphabets recognized by Unicode (Latin, Cyrillic, Greek, Arabic, Hebrew, etc.).
|
@smir-ant and @PauloGoncalvesBH, just refactored the code to implement the same logic but without the regex, now everything is ok at |
i want use it with russian lang, \w is only eng, what about all symbols instead 0-9!@#... or [а-я][a-z]?
(not \w in parse)
The text was updated successfully, but these errors were encountered: