HPDM fetcher/storage transaction batching for indexes

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Done
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Execution NAMR Team 2023-07-10, Execution NAMR Team 2023-07-24
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      2- Investigate to increase the batch size of the storage transaction.

      • Set fetcher batch size - setBatchSize (first batch), setLimit (2nd batch and beyond)
      • See if we still need to further batch the results of the fetcher so that we don't try to do too many collection/index inserts within one WUOW. - we should check that the size of a WUOW batch is < 16MB so that it doesn't go beyond the oplog entry size

            Assignee:
            Matt Kneiser
            Reporter:
            Huayu Ouyang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: