Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-4581

Sudden performance drop occurred while running ycsb_100update with 128 threads on i3.metal

XMLWordPrintableJSON

    • Type: Icon: Improvement Improvement
    • Resolution: Won't Fix
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: perf-investigation
    • Labels:
      None
    • 13
    • Storage Engines 2019-02-25, Storage Engines 2019-03-11

      There is a sudden performance drop occurred while running ycsb update only workload with 128 threads on i3.metal.

       10.0 sec: 2572201 operations; 257194.38 current ops/sec; [UPDATE AverageLatency(us)=458.68] 
 20.0 sec: 4334150 operations; 176194.9 current ops/sec; [UPDATE AverageLatency(us)=522.29] 
 30.0 sec: 4334150 operations; 0 current ops/sec; 
 40.0 sec: 6115566 operations; 178141.6 current ops/sec; [UPDATE AverageLatency(us)=1630.74] 
 50.0 sec: 9159143 operations; 304357.7 current ops/sec; [UPDATE AverageLatency(us)=416.13] 
 60.0 sec: 12199579 operations; 304013.2 current ops/sec; [UPDATE AverageLatency(us)=416.73] 
 70.0 sec: 15234284 operations; 303470.5 current ops/sec; [UPDATE AverageLatency(us)=417.25] 
 80.0 sec: 18261289 operations; 302670.23 current ops/sec; [UPDATE AverageLatency(us)=418.59] 
 90.0 sec: 21226483 operations; 296519.4 current ops/sec; [UPDATE AverageLatency(us)=427.38] 
 100.0 sec: 24145038 operations; 291855.5 current ops/sec; [UPDATE AverageLatency(us)=434.52] 
 110.0 sec: 27098802 operations; 295346.87 current ops/sec; [UPDATE AverageLatency(us)=429.25]

        1. backtrace-forced-eviction-1.png
          backtrace-forced-eviction-1.png
          438 kB
        2. backtrace-forced-eviction-2.png
          backtrace-forced-eviction-2.png
          648 kB
        3. info-thread-forced-eviction-1.png
          info-thread-forced-eviction-1.png
          345 kB
        4. performance_drop_ycsb_100update_128thds_i3metal.png
          performance_drop_ycsb_100update_128thds_i3metal.png
          292 kB
        5. reports.update100.128thds.i3metal.weird.tar.gz
          1.26 MB
        6. wt_threads_yield_at_that_time.png
          wt_threads_yield_at_that_time.png
          151 kB

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            hyeongwon.jang Hyeongwon Jang
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: