Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-6114

Investigate performance drop in WT simple operations

    • Type: Icon: Task Task
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None
    • 8
    • Storage - Ra 2020-05-18

      I am tracking the following wtperf configurations for perf drop. The latest develop (4th May) compared to develop before we merged durable history (0fd1d61d8) with same the wtperf defaults (0fd1d61d8 + WT-6081):

      Attached script runs these workloads limiting them to 30 secs each and extracts the metrics:

      dev-0fd1d61d8
      --------------
      - update-only-btree.wtperf ----
      Load time: 2.91
      load ops/sec: 1719986
      Executed 29316874 update operations (100%) 977229 ops/sec
      ---- medium-btree.wtperf ----
      Load time: 29.09
      load ops/sec: 1718921
      Executed 5878154 read operations (100%) 195938 ops/sec
      ---- evict-btree.wtperf ----
      Load time: 5.80
      load ops/sec: 1722949
      Executed 5168161 read operations (100%) 172272 ops/sec
      ---- update-checkpoint-btree.wtperf ----
      Load time: 2.93
      load ops/sec: 1708233
      Executed 8480479 insert operations (32%) 282682 ops/sec
      Executed 10405996 read operations (39%) 346866 ops/sec
      Executed 7478906 update operations (28%) 249296 ops/sec
      ---- update-large-record-btree.wtperf ----
      Load time: 4.82
      load ops/sec: 103842
      Executed 2025254 update operations (100%) 67508 ops/sec
      ---- modify-large-record-btree.wtperf ----
      Load time: 4.77
      load ops/sec: 104755
      Executed 618478 modify operations (100%) 20615 ops/sec
      ---- modify-force-update-large-record-btree.wtperf ----
      Load time: 4.76
      load ops/sec: 104931
      Executed 640466 modify operations (100%) 21348 ops/sec
      ---- multi-btree-zipfian-populate.wtperf ----
      Executed 3938099 insert operations (100%) 131269 ops/sec
      ---- multi-btree-zipfian-workload.wtperf ----
      Executed 94405436 read operations (100%) 3146847 ops/sec
      
      latest dev:
      ------------
      ---- update-only-btree.wtperf ----
      Load time: 2.90
      load ops/sec: 1725923
      Executed 25451018 update operations (100%) 848367 ops/sec
      ---- medium-btree.wtperf ----
      Load time: 29.02
      load ops/sec: 1723187
      Executed 5065234 read operations (100%) 168841 ops/sec
      ---- evict-btree.wtperf ----
      Load time: 5.82
      load ops/sec: 1717327
      Executed 4311149 read operations (100%) 143704 ops/sec
      ---- update-checkpoint-btree.wtperf ----
      Load time: 2.90
      load ops/sec: 1725923
      Executed 8323124 insert operations (32%) 277437 ops/sec
      Executed 10259666 read operations (39%) 341988 ops/sec
      Executed 7253990 update operations (28%) 241799 ops/sec
      ---- update-large-record-btree.wtperf ----
      Load time: 4.81
      load ops/sec: 104036
      Executed 1877509 update operations (100%) 62583 ops/sec
      ---- modify-large-record-btree.wtperf ----
      Load time: 4.88
      load ops/sec: 102543
      Executed 602617 modify operations (100%) 20087 ops/sec
      ---- modify-force-update-large-record-btree.wtperf ----
      Load time: 4.96
      load ops/sec: 100867
      Executed 616761 modify operations (100%) 20558 ops/sec
      ---- multi-btree-zipfian-populate.wtperf ----
      Executed 3635678 insert operations (100%) 121189 ops/sec
      ---- multi-btree-zipfian-workload.wtperf ----
      Executed 94714323 read operations (100%) 3157144 ops/sec
      

      Regression at the moment:

      Workload regression - insert regression - read regression - update regression - modify
      update-only-btree.wtperf N/A N/A 13.2% N/A
      medium-btree.wtperf N/A 13.8% N/A N/A
      evict-btree.wtperf N/A 16.6% N/A N/A
      update-checkpoint-btree.wtperf 5% 1.4% 3% N/A
      update-large-record-btree.wtperf N/A N/A 7.2% N/A
      modify-large-record-btree.wtperf N/A N/A N/A 2.5%
      modify-force-update-large-record-btree.wtperf N/A N/A N/A 3.7%
      multi-btree-zipfian-populate.wtperf 7.6% N/A N/A N/A
      multi-btree-zipfian-workload.wtperf N/A 0% N/A N/A

            Assignee:
            sulabh.mahajan@mongodb.com Sulabh Mahajan
            Reporter:
            sulabh.mahajan@mongodb.com Sulabh Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: