Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-2731

Optimize index building during initial sync

    XMLWordPrintableJSON

Details

    Description

      I think it would be better if we fetched the indexes before the data and pulled the keys out of the objects while inserting (phase 1 of index building). Then once a collection is finished spawn a bg thread to sort and build all indexes on that collection using the prefetched keys. If we followed this pattern we would never need to read the whole objects off disk which should have a speedup for datasets larger than ram. Also we could make use of idle cycles while waiting for data to come over the network.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              mathias@mongodb.com Mathias Stearn
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: