batch read documents when adding them to the activeBatch

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Fixed
    • Priority: Major - P3
    • 8.2.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Atlas Streams
    • Fully Compatible
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      During initialSyncQuery phase, we are expecting to read a lot of documents continuously. Today, we add each document one at a time to the activeBatch. This requires frequent locking and can become a point of contention if we have too many query threads.

      Add some batching within each thread so that a batch of documents is added to the activeBatch instead of one doc at a time

              Assignee:
              Nathan Frank
              Reporter:
              Mayuresh Kulkarni
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: