Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-15176

New commands for find and getMore

        Details

        • Type: Epic
        • Status: Closed
        • Priority: Major - P3
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: 3.1.9
        • Component/s: Querying
        • Labels:
          None
        • Epic Name:
          find/getMore Commands
        • Backwards Compatibility:
          Fully Compatible
        • Sprint:
          Quint 3.1.0, Quint 9 09/18/15, QuInt A (10/12/15)

          Description

          Implement find and getmore commands to replace the OP_QUERY and OP_GET_MORE wire protocol messages. The wire protocol messages will continue to be supported for backwards compatibility.

          Note that the command framework will be unchanged, so OP_QUERY messages will still be used as the mechanism for issuing all commands to the server.

            Issue Links

            is depended on by

            Task - A task that needs to be done. DRIVERS-211 New commands for find, getMore, and killCursors

            • Critical - P2 - Crashes, loss of data, severe memory leak.
            • Closed

            Task - A task that needs to be done. DOCS-5194 Document that cursor.showDiskLoc() is deprecated, and the new helper is cursor.showRecordId()

            • Major - P3 - Major loss of function.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. SERVER-10448 Revamp explain() formatting

            • Major - P3 - Major loss of function.
            • Closed
            is documented by

            Task - A task that needs to be done. DOCS-5986 Remove documentation of shell's wrapped query format, including $-prefixed query options and _addSpecial()

            • Major - P3 - Major loss of function.
            • Closed

            Task - A task that needs to be done. DOCS-5987 Doc the find and getMore commands

            • Major - P3 - Major loss of function.
            • Closed
            is duplicated by

            Bug - A problem which impairs or prevents the functions of the product. SERVER-8146 sort by array element is incorrect under sharding environment

            • Major - P3 - Major loss of function.
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. SERVER-11878 Results in incorrect order for sharded query with bounded sort on multi-key field

            • Major - P3 - Major loss of function.
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. SERVER-8025 shell supports "query" works as a meta-operator - only "$query" should be supported

            • Minor - P4 - Minor loss of function, or other problem where easy workaround is present.
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. SERVER-9812 User query is interpreted incorrectly if the first field is "query"

            • Minor - P4 - Minor loss of function, or other problem where easy workaround is present.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. SERVER-3129 Include projection in the slow query logs

            • Major - P3 - Major loss of function.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. SERVER-16555 mongoS changes projections for queries for unsharded collections unnecessarily

            • Major - P3 - Major loss of function.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. SERVER-19981 Log query options

            • Major - P3 - Major loss of function.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. SERVER-19094 Use the same default batch size on all server types

            • Minor - P4 - Minor loss of function, or other problem where easy workaround is present.
            • Closed
            is related to

            Bug - A problem which impairs or prevents the functions of the product. SERVER-17011 Cursor can return objects out of order if updated during query ("legacy" readMode only)

            • Major - P3 - Major loss of function.
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. SERVER-18281 lock contention in mongo::DBConnectionPool::get

            • Major - P3 - Major loss of function.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. SERVER-18936 find and getmore commands and LiteParsedQuery should work w/ 64-bit count and size variables

            • Major - P3 - Major loss of function.
            • Closed
            related to

            Sub-task - The sub-task of the issue SERVER-15230 Explain find through the find command

            • Major - P3 - Major loss of function.
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. SERVER-9580 Multiple tailable cursors against the same collection shows high cpu usage on server

            • Major - P3 - Major loss of function.
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. SERVER-19266 An error document is returned with result set

            • Major - P3 - Major loss of function.
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. SERVER-20987 Incorrect or missing merge sort in mongos

            • Major - P3 - Major loss of function.
            • Closed

            Task - A task that needs to be done. SERVER-11960 Better handling of PlanExecutor::FAILURE in getmore

            • Major - P3 - Major loss of function.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. SERVER-15301 Remove uses of query options bit vector

            • Major - P3 - Major loss of function.
            • Open

            Improvement - An improvement or enhancement to an existing feature or task. SERVER-18841 Make awaitData cursors block rather than busy wait in the OP_GET_MORE path

            • Major - P3 - Major loss of function.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. SERVER-3677 $sort should be a synonym for $orderby in query processor.

            • Minor - P4 - Minor loss of function, or other problem where easy workaround is present.
            • Closed

              Issues in Epic

               
              		 SERVER-20944 Contention on ThreadPoolTaskExecutor::_mutex Improvement Closed David Storch
              Actions
               
              		 SERVER-20194 Enable new cursor manager path in mongos for legacy OP_QUERY/OP_GET_MORE/OP_KILLCURSORS query operations Task Closed YunHe Wang
              Actions
               
              		 SERVER-19406 Implement new path for kill cursor operations on mongos Improvement Closed J Rassi
              Actions
               
              		 SERVER-18774 Implement background job to time out mongos ClusterClientCursors Task Closed J Rassi
              Actions
               
              		 SERVER-19569 mongos implementations of cursor-generating commands should use ClusterCursorManager Improvement Closed J Rassi
              Actions
               
              		 SERVER-19405 Update serverStatus command (mongos implementation) to extract cursor statistics from ClusterCursorManager Improvement Closed YunHe Wang
              Actions
               
              		 SERVER-19341 Finalize how read preference and slaveOk are passed for the find command Task Closed David Storch
              Actions
               
              		 SERVER-19797 Hook up find command in mongos to the ClusterCursorManager Task Closed David Storch
              Actions
               
              		 SERVER-19572 Change shell default read mode to "compatibility" Improvement Closed David Storch
              Actions
               
              		 SERVER-20067 Shell should decide whether or not to use find/getMore commands based on on wire protocol version Task Closed David Storch
              Actions
               
              		 SERVER-19568 Diagnostic log operation entry format for find/getMore commands Improvement Closed David Storch
              Actions
               
              		 SERVER-19566 Profiler format changes for the find/getMore commands Improvement Closed David Storch
              Actions
               
              		 SERVER-19570 Shell should issue kill against find command cursors when the cursor object is destroyed Improvement Closed Qingyang Chen
              Actions
               
              		 SERVER-5811 Make a killCursors command New Feature Closed Qingyang Chen
              Actions
               
              		 SERVER-18772 Use ClusterClientCursor framework for OP_QUERY style find on mongos Task Closed Misha Tyulenev
              Actions
               
              		 SERVER-18773 Use ClusterClientCursor framework for OP_GET_MORE to getMore command conversion and execution on mongos Task Closed Misha Tyulenev
              Actions
               
              		 SERVER-18767 Make find command shard version aware Task Closed David Storch
              Actions
               
              		 SERVER-18769 Implement new path for getMore operations on mongos Task Closed David Storch
              Actions
               
              		 SERVER-18771 Implement getMore command on mongos Task Closed David Storch
              Actions
               
              		 SERVER-18766 Implement manager for ClusterClientCursor Task Closed J Rassi
              Actions
               
              		 SERVER-18765 Implement ClusterClientCursor Task Closed David Storch
              Actions
               
              		 SERVER-18768 Implement new path for .find() operations on mongos Task Closed David Storch
              Actions
               
              		 SERVER-18770 Implement ClusterFindCmd::run() Task Closed David Storch
              Actions
               
              		 SERVER-18932 LiteParsedQuery should keep a const NamespaceString rather than a std::string for its _ns member Improvement Closed Qingyang Chen
              Actions
               
              		 SERVER-18936 find and getmore commands and LiteParsedQuery should work w/ 64-bit count and size variables Improvement Closed Qingyang Chen
              Actions
               
              		 SERVER-17575 Handle BSONObj size limits for find/getMore commands Task Closed David Storch
              Actions
               
              		 SERVER-18184 Add awaitData support to getMore command Task Closed David Storch
              Actions
               
              		 SERVER-17577 Allow the query system to make use of differentiating between batchSize and limit Task Closed David Storch
              Actions
               
              		 SERVER-17284 Implement find and getMore commands on mongos Task Closed David Storch
              Actions
               
              		 SERVER-17544 find/getMore commands cleanup and testing Task Closed David Storch
              Actions
               
              		 SERVER-18849 find/getMore against config server content cannot use new host targeting logic Task Closed David Storch
              Actions
               
              		 SERVER-19355 Support skip, limit, and projection in new find/getMore commands path on mongos Task Closed David Storch
              Actions
               
              		 SERVER-19842 Support allowPartialResults in new mongos read path Task Closed David Storch
              Actions
               
              		 SERVER-19737 Add ClusterCursorManager shutdown logic to mongos shutdown sequence Improvement Closed J Rassi
              Actions
               
              		 SERVER-17286 Update mongo shell for find and getMore commands Task Closed David Storch
              Actions
               
              		 SERVER-17718 change showDiskLoc to showRecordId Improvement Closed David Storch
              Actions
               
              		 SERVER-17285 Mongos upconversion/downconversion between find/getMore commands and legacy find/getMore Task Closed David Storch
              Actions
               
              		 SERVER-17764 Extend commands authorization test for find and getMore commands Task Closed David Storch
              Actions
               
              		 SERVER-17282 Implement find command on mongod Task Closed David Storch
              Actions
               
              		 SERVER-17283 Implement getMore command on mongod Task Closed David Storch
              Actions
               
              		 SERVER-18332 Command form of getMore should support maxTimeMs Improvement Closed David Storch
              Actions
               
              		 SERVER-18775 Implement downconversion of find command to OP_QUERY style find on mongos Task Closed David Storch
              Actions
               
              		 SERVER-18776 Implement downconversion of getMore command to OP_GET_MORE on mongos Task Closed David Storch
              Actions
               
              		 SERVER-19033 find command should validate 1st parameter Bug Closed David Storch
              Actions
               
              		 SERVER-19408 Implement downconversion of killCursors command to OP_KILL_CURSORS on mongos Improvement Closed Unassigned
              Actions
               
              		 SERVER-19409 Implement upconversion of OP_KILL_CURSORS to killCursors command on mongos Task Closed J Rassi
              Actions
               
              		 SERVER-16398 Remove support for "cursorInfo" command Improvement Closed Qingyang Chen
              Actions
               
              		 SERVER-19571 Allow configuration of shell read mode with resmoke.py, add "commands" read mode coverage to CI loop Improvement Closed David Storch
              Actions
               
              		 SERVER-19665 Find and getMore commands should use a default timeout of 1 second for tailable, awaitData cursors Task Closed Qingyang Chen
              Actions
               
              		 SERVER-19928 Find command should reject requests to read special command namespaces Improvement Closed Qingyang Chen
              Actions
               
              		 SERVER-19946 Support the tailable option for unsharded capped collections in the new mongos read path Task Closed David Storch
              Actions
               
              		 SERVER-20267 Upconvert $explain option for OP_QUERY find to an explain command on mongos Task Closed David Storch
              Actions
               
              		 SERVER-20395 ClusterFind::runQuery cant not detect if a collection became unsharded Bug Closed Misha Tyulenev
              Actions
               
              		 SERVER-20537 Re-enable tests disabled when OP_QUERY legacy ops in mongos are made to use new find command path Bug Closed J Rassi
              Actions
               
              		 SERVER-20630 Find command on mongod needs to wait until out of critical section on shard version errors Bug Closed Misha Tyulenev
              Actions
              DOCS-9569 Docs for SERVER-5811: Make a killCursors command Task Open Kay Kim
              Actions

                Activity

                • Comments
                Ascending order - Click to sort in descending order
                Hide
                Permalink
                xgen-internal-githook Githook User added a comment -

                Author:

                {u'username': u'dstorch', u'name': u'David Storch', u'email': u'david.storch@10gen.com'}

                Message: SERVER-15176 remove dead code from find.cpp
                Branch: master
                https://github.com/mongodb/mongo/commit/875b0c2c020e0d6cd88a9b3fad5625b8e82b31cb

                Show
                xgen-internal-githook Githook User added a comment - Author: {u'username': u'dstorch', u'name': u'David Storch', u'email': u'david.storch@10gen.com'} Message: SERVER-15176 remove dead code from find.cpp Branch: master https://github.com/mongodb/mongo/commit/875b0c2c020e0d6cd88a9b3fad5625b8e82b31cb
                Hide
                Permalink
                xgen-internal-githook Githook User added a comment -

                Author:

                {u'username': u'dstorch', u'name': u'David Storch', u'email': u'david.storch@10gen.com'}

                Message: SERVER-15176 remove CollectionMetadataPtr from ClientCursor

                This was used for filtering orphaned chunks. However, it no longer needs to be stashed
                in the ClientCursor, as it now lives in the ShardFilterStage.
                Branch: master
                https://github.com/mongodb/mongo/commit/93254f6576ed86c8f459a6d0ec419e23618abd21

                Show
                xgen-internal-githook Githook User added a comment - Author: {u'username': u'dstorch', u'name': u'David Storch', u'email': u'david.storch@10gen.com'} Message: SERVER-15176 remove CollectionMetadataPtr from ClientCursor This was used for filtering orphaned chunks. However, it no longer needs to be stashed in the ClientCursor, as it now lives in the ShardFilterStage. Branch: master https://github.com/mongodb/mongo/commit/93254f6576ed86c8f459a6d0ec419e23618abd21
                Hide
                Permalink
                xgen-internal-githook Githook User added a comment -

                Author:

                {u'username': u'dstorch', u'name': u'David Storch', u'email': u'david.storch@10gen.com'}

                Message: SERVER-15176 SERVER-17721 add oplogReplay support to find command

                Introduces getExecutorFind(), a unified way to retrieve a PlanExecutor for find operations.
                Branch: master
                https://github.com/mongodb/mongo/commit/4e2bd6f18b2fc9b27465e098331562e0f06fc40d

                Show
                xgen-internal-githook Githook User added a comment - Author: {u'username': u'dstorch', u'name': u'David Storch', u'email': u'david.storch@10gen.com'} Message: SERVER-15176 SERVER-17721 add oplogReplay support to find command Introduces getExecutorFind(), a unified way to retrieve a PlanExecutor for find operations. Branch: master https://github.com/mongodb/mongo/commit/4e2bd6f18b2fc9b27465e098331562e0f06fc40d
                Hide
                Permalink
                david.storch David Storch added a comment -

                The find and getMore commands are feature complete in the shell, mongod, and mongos as of https://github.com/mongodb/mongo/commit/df2a33f9974950ebe484edfa29171cec53071b0a. Closing this ticket as Fixed.

                Show
                david.storch David Storch added a comment - The find and getMore commands are feature complete in the shell, mongod, and mongos as of https://github.com/mongodb/mongo/commit/df2a33f9974950ebe484edfa29171cec53071b0a . Closing this ticket as Fixed.
                Hide
                Permalink
                xgen-internal-githook Githook User added a comment -

                Author:

                {u'username': u'dstorch', u'name': u'David Storch', u'email': u'david.storch@10gen.com'}

                Message: SERVER-15176 clean up db.coll.find().help()
                Branch: master
                https://github.com/mongodb/mongo/commit/f3e6dadf23a81fa396a96e33b0fc6e5aedd3fe51

                Show
                xgen-internal-githook Githook User added a comment - Author: {u'username': u'dstorch', u'name': u'David Storch', u'email': u'david.storch@10gen.com'} Message: SERVER-15176 clean up db.coll.find().help() Branch: master https://github.com/mongodb/mongo/commit/f3e6dadf23a81fa396a96e33b0fc6e5aedd3fe51

                  People

                  • Votes:
                    1 Vote for this issue
                    Watchers:
                    20 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved:

                        Agile