Bulk insert provides little improvement in overall performance with much higher cpu usage

XMLWordPrintableJSON

    • Type: Question
    • Resolution: Done
    • Priority: Minor - P4
    • None
    • Affects Version/s: 3.4.0-rc1
    • Component/s: WiredTiger
    • None
    • Fully Compatible
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      Windows 2012R2, WT

      With an insert-only workload, using the bulk-insert api provides a ~2x improvement in throughput. Using the same test as SERVER-26753, but simply using a bulk-insert of 10 documents (whereas the original test inserted 1), the overall steady-state performance is marginally improved (~3%) but the cpu usage goes from ~55% to 100%.

      I realize we are asking more of the DB, but I'm surprised at how little of an improvement there is given the significant increase in CPU usage. Is it possible there is a significant amount of time spent spinning?

      Please see the attached diagnostics.

        1. RC2.bulk-insert.metrics.2016-11-04T18-00-22Z-00000
          184 kB
          Nick Judson
        2. bulk-insert.metrics.2016-11-04T17-41-13Z-00000
          150 kB
          Nick Judson
        3. single-insert.metrics.2016-11-04T17-33-32Z-00000
          128 kB
          Nick Judson

            Assignee:
            David Hows (Inactive)
            Reporter:
            Nick Judson
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

              Created:
              Updated:
              Resolved: