Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-16908

Performance Regression in Foreground Index Builds with MMAPv1

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical - P2
    • Resolution: Fixed
    • Affects Version/s: 2.8.0-rc5
    • Fix Version/s: 3.0.0-rc6
    • Component/s: Index Maintenance
    • Labels:
      None
    • Backwards Compatibility:
      Fully Compatible
    • Operating System:
      ALL
    • Steps To Reproduce:
      Hide

      Run the attached script, but modify the list of hosts at the bottom to reflect the workload target hosts (localhost:27107 is the first host by default).

      The script reports the amount of time (in milliseconds) each index build takes, as well as the initial insert phase.

      Show
      Run the attached script, but modify the list of hosts at the bottom to reflect the workload target hosts (localhost:27107 is the first host by default). The script reports the amount of time (in milliseconds) each index build takes, as well as the initial insert phase.

      Description

      In v2.8-rc5 with mmapv1, foreground index builds are ~10-30% slower than v2.6.6. Wired Tiger is ~5% - 30% faster than v2.6.6.

      Results:

      {
        insert_500000_docs: 238229ms,
        build_fg_ascending: 1715ms,
        build_fg_descending: 1838ms,
        build_fg_random: 3162ms,
        build_fg_unique: 1979ms,
        build_fg_sparse: 2228ms,
        build_fg_multikey: 10051ms,
        build_fg_string: 4205ms,
        build_fg_text: 25846ms,
        build_fg_hash: 2259ms,
        version: 2.6.6,
        storage_engine: mmapv1
      },
      {
        insert_500000_docs: 268692ms,
        build_fg_ascending: 2944ms,
        build_fg_descending: 2463ms,
        build_fg_random: 3369ms,
        build_fg_unique: 2591ms,
        build_fg_sparse: 2820ms,
        build_fg_multikey: 10759ms,
        build_fg_string: 3947ms,
        build_fg_text: 24254ms,
        build_fg_hash: 2511ms,
        version: 2.8.0-rc2,
        storage_engine: mmapv1
      },
      {
        insert_500000_docs: 271507ms,
        build_fg_ascending: 2569ms,
        build_fg_descending: 2552ms,
        build_fg_random: 3370ms,
        build_fg_unique: 2658ms,
        build_fg_sparse: 2803ms,
        build_fg_multikey: 11021ms,
        build_fg_string: 3989ms,
        build_fg_text: 25493ms,
        build_fg_hash: 2603ms,
        version: 2.8.0-rc4,
        storage_engine: mmapv1
      },
      {
        insert_500000_docs: 268413ms,
        build_fg_ascending: 2303ms,
        build_fg_descending: 2327ms,
        build_fg_random: 3274ms,
        build_fg_unique: 2499ms,
        build_fg_sparse: 2661ms,
        build_fg_multikey: 10371ms,
        build_fg_string: 3727ms,
        build_fg_text: 23728ms,
        build_fg_hash: 2394ms,
        version: 2.8.0-rc5,
        storage_engine: mmapv1
      },
      {
      Cannot use commands write mode, degrading to compatibility mode
        insert_500000_docs: 288943ms,
        build_fg_ascending: 1960ms,
        build_fg_descending: 1981ms,
        build_fg_random: 2972ms,
        build_fg_unique: 2044ms,
        build_fg_sparse: 2303ms,
        build_fg_multikey: 11945ms,
        build_fg_string: 3345ms,
        build_fg_text: 221ms,
        build_fg_hash: 2202ms,
        version: 2.4.9,
        storage_engine: mmapv1
      },
      {
        insert_500000_docs: 254796ms,
        build_fg_ascending: 1772ms,
        build_fg_descending: 1610ms,
        build_fg_random: 2566ms,
        build_fg_unique: 1802ms,
        build_fg_sparse: 2022ms,
        build_fg_multikey: 8351ms,
        build_fg_string: 3122ms,
        build_fg_text: 20574ms,
        build_fg_hash: 1776ms,
        version: 2.8.0-rc5,
        storage_engine: wiredTiger
      }

        Attachments

          Activity

            People

            Assignee:
            milkie Eric Milkie
            Reporter:
            benjamin.becker Ben Becker
            Participants:
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: