Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-2731

Optimize index building during initial sync

    XMLWordPrintableJSON

Details

    Description

      I think it would be better if we fetched the indexes before the data and pulled the keys out of the objects while inserting (phase 1 of index building). Then once a collection is finished spawn a bg thread to sort and build all indexes on that collection using the prefetched keys. If we followed this pattern we would never need to read the whole objects off disk which should have a speedup for datasets larger than ram. Also we could make use of idle cycles while waiting for data to come over the network.

      Attachments

        Activity

          People

            Unassigned Unassigned
            mathias@mongodb.com Mathias Stearn
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: