Uploaded image for project: 'Python Driver'
  1. Python Driver
  2. PYTHON-1860

Use OP_MSG not OP_GET_MORE in find_raw_batches and aggregate_raw_batches

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • None
    • 3.12, 4.0
    • API

    Description

      The server will soon deprecate support for legacy wire protocol message types. We should stop using OP_GET_MORE in find_raw_batches/aggregate_raw_batches and use OP_MSG instead. This may have a negative performance impact because OP_MSG returns a documents in a BSON array that we will have to massage into the document stream format that OP_GET_MORE returns.

      Another reason to make this change is that mixing new and old wire protocol messages on the same cursor is somewhat of a gray area.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. ARROW-82 With pymongo>=3.12 pymongoarrow is slower than the naive approach

          • Unknown - Priority not determined yet.
          • Closed

          Task - A task that needs to be done. PYTHON-2734 Test failure - test_cursor.TestRawBatchCursor.test_read_concern

          • Unknown - Priority not determined yet.
          • Closed
          has to be done before

          Task - A task that needs to be done. PYTHON-2720 Add mockupDB tests for using OP_MSG for raw batches and exhaust cursors

          • Major - P3 - Major loss of function.
          • Closed
          is depended on by

          New Feature - A new feature of the product, which has yet to be developed. PYTHON-2389 Add session support to find_raw_batches and aggregate_raw_batches

          • Major - P3 - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. PYTHON-2592 find_raw_batches raises exception on Views

          • Major - P3 - Major loss of function.
          • Closed
          is related to

          New Feature - A new feature of the product, which has yet to be developed. PYTHON-1636 Support Exhaust Cursor in OP_MSG

          • Major - P3 - Major loss of function.
          • Closed
          related to

          Task - A task that needs to be done. PYTHON-2722 Improve performance of find/aggregate_raw_batches

          • Unknown - Priority not determined yet.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. PYTHON-2735 CSFLE support for find/aggregate_raw_batches

          • Minor - P4 - Minor loss of function, or other problem where easy workaround is present.
          • Backlog

          Activity

            People

              prashant.mital Prashant Mital (Inactive)
              shane.harvey@mongodb.com Shane Harvey
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: