Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-78137

HPDM fetcher/storage transaction batching for indexes

    XMLWordPrintableJSON

Details

    • Icon: Task Task
    • Resolution: Done
    • Icon: Major - P3 Major - P3
    • None
    • None
    • None
    • None
    • Execution NAMR Team 2023-07-10, Execution NAMR Team 2023-07-24

    Description

      2- Investigate to increase the batch size of the storage transaction.

      • Set fetcher batch size - setBatchSize (first batch), setLimit (2nd batch and beyond)
      • See if we still need to further batch the results of the fetcher so that we don't try to do too many collection/index inserts within one WUOW. - we should check that the size of a WUOW batch is < 16MB so that it doesn't go beyond the oplog entry size

      Attachments

        Activity

          People

            matt.kneiser@mongodb.com Matt Kneiser
            huayu.ouyang@mongodb.com Huayu Ouyang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: