[SERVER-10471] develop query planner Created: 09/Aug/13  Updated: 02/Aug/18  Resolved: 11/Oct/13

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 2.5.3

Type: Task Priority: Major - P3
Reporter: hari.khalsa@10gen.com Assignee: hari.khalsa@10gen.com
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
duplicates SERVER-4485 unify index suitability code Closed
Related
related to SERVER-11132 "table scans not allowed" during para... Closed
related to SERVER-11679 improve query planner test Closed
Participants:

 Description   

Get all indices from catalog
Compute all "good" combinations of indices (really a power set but heuristics)

For each batch of indices (received in goodness order in batches):
1. Logical rewrite (noop for now)
2. Covering analysis
3. Sort analysis
4. If possible, ship

If no indices shipped, output collscan.



 Comments   
Comment by Githook User [ 19/Nov/13 ]

Author:

{u'username': u'dstorch', u'name': u'David Storch', u'email': u'david.storch@10gen.com'}

Message: SERVER-10471 fix OR with inexact bounds

Signed-off-by: Matt Kangas <matt.kangas@mongodb.com>
Branch: master
https://github.com/mongodb/mongo/commit/5a2c6c18c1bfa0a141a40b02e0cbb32de110f9c0

Comment by auto [ 12/Oct/13 ]

Author:

{u'username': u'jrassi', u'name': u'Jason Rassi', u'email': u'rassi@10gen.com'}

Message: SERVER-10471 Correctly save result of function call in newRunQuery

Return value of getRunner() was being discarded by destruction of
shadow variable.
Branch: master
https://github.com/mongodb/mongo/commit/3a2776f0d66a03cd2c8de51117e14a0afffb716e

Comment by auto [ 11/Oct/13 ]

Author:

{u'username': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-10471 Note differences in test behavior between new and old query systems.
Branch: master
https://github.com/mongodb/mongo/commit/6c50d750e168eebf68b9b79d6ab9306cc3ad6aa7

Comment by auto [ 10/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 remove flaky ordering
Branch: master
https://github.com/mongodb/mongo/commit/b5121aef9a69e4f9bef2e71457e6840b0f97576a

Comment by auto [ 10/Oct/13 ]

Author:

{u'username': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-10471 Note differences in test behavior between new and old query systems
Branch: master
https://github.com/mongodb/mongo/commit/5cdcedd9902edb97985a21df3b4e6f8a2cd483cf

Comment by auto [ 10/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 take chunk skips into account for explain, hold lock for parsing for where
Branch: master
https://github.com/mongodb/mongo/commit/59fbb0a9cb15096c3ebd5ad6b9f6e337d0b73dfe

Comment by auto [ 10/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 don't forget to turn table scans back on
Branch: master
https://github.com/mongodb/mongo/commit/b2ee3b565e5f721e671db1480396de39dcaa9d97

Comment by auto [ 10/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 add (default off) param for super verbose query logging
Branch: master
https://github.com/mongodb/mongo/commit/c8bed4944dac6bf3f08831773d26068413b1388a

Comment by auto [ 10/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 document some planning shortcomings wrt elemmatch
Branch: master
https://github.com/mongodb/mongo/commit/3ef2c5215d98df154d6aa01da16c3dc5c6f4007a

Comment by auto [ 10/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 comment out and annotate a few tests that rely on quirks of old planner
Branch: master
https://github.com/mongodb/mongo/commit/c88e13fbe4afc8bb1089c20fbe3fc2031a2f5da4

Comment by auto [ 10/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 comment test and make sure it doesn't table scan
Branch: master
https://github.com/mongodb/mongo/commit/3a24d28e23f8ef86ae5b592ea103420c8868f58b

Comment by auto [ 10/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 remove tests that expect geo idx to be used for searching for equality with an array
Branch: master
https://github.com/mongodb/mongo/commit/13f3b5dd4b0f9a2defd0c8a1aec78a6fb44228b6

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 fix test by no longer trying to dereference null
Branch: master
https://github.com/mongodb/mongo/commit/d66535982976960ada4d2a05db213e40d08740ab

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 init to NULL to avoid warning
Branch: master
https://github.com/mongodb/mongo/commit/18730d0b894b1e6c4494041b4936a742842e87d1

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 fix tree traversal code and build
Branch: master
https://github.com/mongodb/mongo/commit/9ebc833bd9966a83b4dc4f83a0e4c2de422e1846

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 some commenting
Branch: master
https://github.com/mongodb/mongo/commit/24031eede8fbc6cf75a1854f7a1427d05da8746f

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 route 2d geonear queries to old system
Branch: master
https://github.com/mongodb/mongo/commit/0f7940d5395f0af129337de2f53f0e23fcec50f2

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 migrate plan cache tests to tmp directory during migration
Branch: master
https://github.com/mongodb/mongo/commit/1da79b6df6a930139cddba33229d969f2c286180

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 fix bounds checker bug
Branch: master
https://github.com/mongodb/mongo/commit/655e78b8742ddaa860b8fb1cee4edc4368ac09ca

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 fix intervals generated for minkey/maxkey lt(e) gt(e), modify spigot
Branch: master
https://github.com/mongodb/mongo/commit/3c831f3014fe9502a1ec78afce0448757bf7d7f7

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 remove bad selectivity guess
Branch: master
https://github.com/mongodb/mongo/commit/3aa47f21fa5d0370cd7a0ef277e7d1d8d359edbb

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 set a limit when a limit is requested
Branch: master
https://github.com/mongodb/mongo/commit/b467c670b3020f650c367a9e943c6281a475d89f

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 hint can be key pattern or name
Branch: master
https://github.com/mongodb/mongo/commit/aef4db124df3be35e544fbd4c39705a67f673646

Comment by auto [ 09/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 for multikey indices only assign one pred to each field
Branch: master
https://github.com/mongodb/mongo/commit/627744b1cdac2dc2103ee69ae65f94212ccd97b3

Comment by auto [ 07/Oct/13 ]

Author:

{u'username': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-10471 Report min/maxKey properly; ditto reverse index scans
Branch: master
https://github.com/mongodb/mongo/commit/df04b01b1b6aa2ef56406f4a53ead3b9fe472f43

Comment by auto [ 07/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 fix test to deal w/new interval comparison state
Branch: master
https://github.com/mongodb/mongo/commit/50c817d7dbfcb0764e921248d510a62b1b39330e

Comment by auto [ 07/Oct/13 ]

Author:

{u'username': u'jrassi', u'name': u'Jason Rassi', u'email': u'rassi@10gen.com'}

Message: SERVER-10471 Clone tag correctly in RelevantTag::clone()
Branch: master
https://github.com/mongodb/mongo/commit/ca8b122cd49c049a6a8aa220b91a2f49687c69fb

Comment by auto [ 07/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 merge index bounds, enumerate based on indices, bug fixes
Branch: master
https://github.com/mongodb/mongo/commit/a5c4104bb28f2870602a8c7a5e4a4b506dbc99a1

Comment by auto [ 05/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 geojson points are SPHERE not FLAT, woops.
Branch: master
https://github.com/mongodb/mongo/commit/2ecb17f186ba8bde7dd22c409b1c93be6ba08a79

Comment by auto [ 05/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 dont use near as variable name, fix test
Branch: master
https://github.com/mongodb/mongo/commit/0a3c952a2490e9e995d3773d89e085db6d042d2a

Comment by auto [ 05/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 add s2near stage, enable all 2dsphere queries, enable 2d queries (just slow).
Branch: master
https://github.com/mongodb/mongo/commit/ab167c642f49206b4328882286cd5b83c19088bd

Comment by auto [ 04/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 fix win64 build by not going out of array bounds
Branch: master
https://github.com/mongodb/mongo/commit/060a5527947a4facdacfb15cbbfa18d75dbfdb19

Comment by auto [ 02/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 more comments based on review
Branch: master
https://github.com/mongodb/mongo/commit/cd2d98b52ea1c3f11e0e733f1315723130ffbe67

Comment by auto [ 02/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 fix build, always output collscans in test
Branch: master
https://github.com/mongodb/mongo/commit/a65c8d5a1d26ab3a06f664b9c683f9c4b4cfaf93

Comment by auto [ 02/Oct/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 multikey correctness, fix compound idxs, a few bug fixes
Branch: master
https://github.com/mongodb/mongo/commit/3b14e72704f640aff26385142d1aa61666e912fc

Comment by auto [ 30/Sep/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 enumerate indices w/array operators correctly, clean up and comment planner
Branch: master
https://github.com/mongodb/mongo/commit/257d3f5361627bdd1b719c288381a959793246a2

Comment by auto [ 27/Sep/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 pseudo-expression/hashed indices
Branch: master
https://github.com/mongodb/mongo/commit/56eb5057b8d817026ea299249bbc428da3b11a6f

Comment by auto [ 26/Sep/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 switch to memoization enumerator
Branch: master
https://github.com/mongodb/mongo/commit/15db6be024ef4d385e09047357f1a61fe824aee8

Comment by auto [ 23/Sep/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 covering and sort analysis. split projection parse from exec
Branch: master
https://github.com/mongodb/mongo/commit/44ae87438efc76040d93b039233d7f2ff4f46e3d

Comment by auto [ 23/Sep/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10026 SERVER-10471 planner bug fixes from going through tests
Branch: master
https://github.com/mongodb/mongo/commit/fc8201aec8acb3ee46fde6915702f1269b448c6c

Comment by auto [ 20/Sep/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 query solutions export properties to allow uniform optimization of covering/sort/fetch
Branch: master
https://github.com/mongodb/mongo/commit/b8d5ea09f7d34b9f1d4e438b101291cc2e27bcc2

Comment by auto [ 13/Sep/13 ]

Author:

{u'username': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-10471 Fix enumerator test placeholder
Branch: master
https://github.com/mongodb/mongo/commit/4f807d17e26a182692b451c4c980e336c0e3a0f1

Comment by auto [ 12/Sep/13 ]

Author:

{u'username': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-10471 Fleshing out the new query planner / enumerator
Branch: master
https://github.com/mongodb/mongo/commit/755dee05b9bbc5059b61ec09085c8ef003eb3f74

Comment by auto [ 29/Aug/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10026 SERVER-10471 begin more sustainable planning approach
Branch: master
https://github.com/mongodb/mongo/commit/399c4e2ef06e62cf5c5725ebae4d3d981d0a755c

Comment by auto [ 26/Aug/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10026 SERVER-10471 remove query planner test
Branch: master
https://github.com/mongodb/mongo/commit/dea748ec5697dab634deb90755720cc6cdc7f4ef

Comment by auto [ 15/Aug/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10471 lt(e) gt(e)
Branch: master
https://github.com/mongodb/mongo/commit/35008eaeaebf8245af14f0ea9bbca42b51ed23e2

Comment by auto [ 12/Aug/13 ]

Author:

{u'username': u'hkhalsa', u'name': u'Hari Khalsa', u'email': u'hkhalsa@10gen.com'}

Message: SERVER-10026 SERVER-10471 unittestable query planner
Branch: master
https://github.com/mongodb/mongo/commit/69f264e93dee509597f787773e1f05e1ec313d2b

Generated at Thu Feb 08 03:23:15 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.