-
Type:
Task
-
Resolution: Done
-
Priority:
Major - P3
-
Affects Version/s: None
-
Component/s: Text Search
-
None
-
Fully Compatible
-
Platform 1 04/03/15
-
None
-
3
-
None
-
None
-
None
-
None
-
None
-
None
-
None
To support third-party tokenizers, Mongo needs to create an abstract interface for document tokenization.
- Create an abstract interface
- Move all code to use the new interface except V1 legacy
- Create an implementation for our
class FtsTokenizer { virtual ~FtsTokenizer() virtual void reset(const char* document) = 0; // Process a new doc virtual bool moveNext() = 0; // Moves to the next token virtual StringData& getStem() = 0; // Returns stemmed form };
- is duplicated by
-
SERVER-10842 Implement an interface for tokenizer
-
- Closed
-