Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-81568

Batch Bulk inserts during the indexing collection scan

    XMLWordPrintableJSON

Details

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Major - P3 Major - P3
    • None
    • None
    • None
    • Storage Execution

    Description

      As a result of investigating SERVER-676 we discovered that simply batching bulk inserts at the end revealed a significant increase in performance during index builds.

      Right now inserts are performed 1-by-1, incurring the overhead of an entire WriteUnitOfWork for it. As we saw with BatchedDeletes, batching would alleviate the overhead.

      The very rough patch attached here yielded an approximate 10% improvement in throughput.

      Attachments

        Activity

          People

            backlog-server-execution Backlog - Storage Execution Team
            jordi.olivares-provencio@mongodb.com Jordi Olivares Provencio
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated: