[SERVER-8398] Review Russian stop word list Created: 30/Jan/13  Updated: 11/Jul/16  Resolved: 26/Feb/13

Status: Closed
Project: Core Server
Component/s: Text Search
Affects Version/s: 2.3.2
Fix Version/s: 2.4.0-rc2

Type: Task Priority: Major - P3
Reporter: Daniel Pasette (Inactive) Assignee: Asya Kamsky
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Participants:

 Description   

https://github.com/mongodb/mongo/blob/master/src/mongo/db/fts/stop_words_russian.txt



 Comments   
Comment by Asya Kamsky [ 09/Feb/13 ]

I divided the problem with this list of words (and there are many) into four parts:

1. Words that are on the list that should not be.
2. Words that are forms missing from the list while some of the forms are on the list.
3. Words that are common in Russian that should be on the list and are not.
4. Special class of related words - these are on the list and either should be removed or made more complete.

1. Remove from list:
алло
вдруг
времени
даром
жизнь
мира
мор
непрерывно
сеаой

Probably remove from list:
вверх
вдали
вниз
внизу
вокруг

2. Add missing forms of present words to list:
дела
дело
говорила
годы
какое
миллионы
миллион
могла
могли
могу
мои
нём
нету
ним
нужен
нужна
нужны
нужный
обы
одна
одни
одново
стала
стали
сказали
стали
стала
твои
твое
тысячи
хочу
частый
частая
суметь
умею and friends

3. Add to list:
ничто
никто
последнего
последнее
последней
последнем
последнему
последнею
последние
последний
последним
последними
последних
последнюю
последнее
последней
последняя
последнего
свой
своё
самый
стать
сразу

4. Decide what to do with:
первый
второй
третий
четвертый
пятый
шестой
седьмой
восьмой
девятый
десятый
одиннадцатый
двенадцатый
тринадцатый
четырнадцатый
пятнадцатый
шестнадцатый
семнадцатый
восемнадцатый
девятнадцатый
двадцатый

The above are all ordinal form of numbers 1-20 (first, second, third, etc) but in masculine singular form only. Either they should be removed or feminine singular, neuter singluar and plural form of each one added.

The list of forms to add is not quite complete (as you can see from adjective последний which means "last" it has many forms and most other adjectives do as well)

Generated at Thu Feb 08 03:17:19 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.