[SERVER-20888] $language in $text queries does not recognize RLP languages Created: 12/Oct/15  Updated: 25/Nov/15  Resolved: 18/Nov/15

Status: Closed
Project: Core Server
Component/s: Querying, Text Search
Affects Version/s: 3.1.9
Fix Version/s: 3.2.0-rc4

Type: Bug Priority: Major - P3
Reporter: Mark Benvenuto Assignee: Mark Benvenuto
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Duplicate
duplicates SERVER-19510 Text query parsing should be moved to... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Participants:
Linked BF Score: 0

 Description   

Setup

db.ara.drop();
 
// http://en.wikipedia.org/wiki/Arabic_verbs
db.ara.insert({ _id: "past_writes", t1: "كَتَبْتُ" });
db.ara.insert({ _id: "present_writes", t1: "أَكْتُبُ" });
db.ara.insert({ _id: "future_writes", t1: "سَأَكْتُبُ" });
 
db.ara.ensureIndex({ t1: "text" }, { default_language: "arabic" });

This query works

db.ara.find( { "$text" : { "$search" : "كتب" } } )

But this query fails when it should work

db.ara.find( { "$text" : { "$search" : "كتب", $language : "arabic" } } )
Error: error: {
        "waitedMS" : NumberLong(0),
        "ok" : 0,
        "errmsg" : "$language specifies unsupported language",
        "code" : 2
}



 Comments   
Comment by Githook User [ 18/Nov/15 ]

Author:

{u'username': u'jrassi', u'name': u'Jason Rassi', u'email': u'rassi@10gen.com'}

Message: SERVER-20888: Verify $language works for RLP languages

(cherry picked from commit 865e8bbc6a0184ec6fb24a7b9decc528567b3eb7)
Branch: master
https://github.com/10gen/mongo-enterprise-modules/commit/01c2836220b69cd110028b260625446fbcbbfb7e

Comment by Mark Benvenuto [ 26/Oct/15 ]

Original fix create a memory leak caught by the ASAN builder. An alternative fix will be needed, but the alternatives are very complicated, and more involved.

Comment by Githook User [ 26/Oct/15 ]

Author:

{u'username': u'markbenvenuto', u'name': u'Mark Benvenuto', u'email': u'mark.benvenuto@mongodb.com'}

Message: Revert "SERVER-20888: Defer $language check to FTSQuery::Parse"

This reverts commit 4c38ff13739e60d33d52b0c944d55249e7d9cc68.
Branch: master
https://github.com/mongodb/mongo/commit/1c91d1a2b789fef8be6427de81c35658ff30009d

Comment by Githook User [ 26/Oct/15 ]

Author:

{u'username': u'markbenvenuto', u'name': u'Mark Benvenuto', u'email': u'mark.benvenuto@mongodb.com'}

Message: Revert "SERVER-20888: Verify $language works for RLP languages"

This reverts commit 865e8bbc6a0184ec6fb24a7b9decc528567b3eb7.
Branch: master
https://github.com/10gen/mongo-enterprise-modules/commit/24a7b4613e0c96c3c584b99b19835488ed54ca60

Comment by Githook User [ 23/Oct/15 ]

Author:

{u'username': u'markbenvenuto', u'name': u'Mark Benvenuto', u'email': u'mark.benvenuto@mongodb.com'}

Message: SERVER-20888: Verify $language works for RLP languages
Branch: master
https://github.com/10gen/mongo-enterprise-modules/commit/865e8bbc6a0184ec6fb24a7b9decc528567b3eb7

Comment by Githook User [ 23/Oct/15 ]

Author:

{u'username': u'markbenvenuto', u'name': u'Mark Benvenuto', u'email': u'mark.benvenuto@mongodb.com'}

Message: SERVER-20888: Defer $language check to FTSQuery::Parse
Branch: master
https://github.com/mongodb/mongo/commit/4c38ff13739e60d33d52b0c944d55249e7d9cc68

Generated at Thu Feb 08 03:55:36 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.