XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major - P3 Major - P3
    • None
    • None
    • Admin, Concurrency
    • None
    • ALL

    Description

      I have tested  with the ycsb tool  in MongoDB 3.4.14 and MongoDB  4.0.0
      of course, 2 MongoDB instances are the same architecture ( H/W, OS,  mongo conf)
      and MongoDB  is a replica set (3 members per instance)

      I expected MongoDB 4.0.0 better performance then 4.0.0, but as below results, 3.4.14 is better then 4.0.0

      can you teach me how to test correctly?
      otherwise is this result is right?

       

      1)  used tool (https://github.com/brianfrankcooper/YCSB/releases/download/0.14.0/ycsb-0.14.0.tar.gz)

      2) test script

      <load>

      ycsb load mongodb -s -P ycsb-0.14.0/workloads/workloada \

      -p recordcount=1000000 -threads 4 \

      -p mongodb.url="[mongodb://sysbench:mongobench@localhost:20011/mongoycsb]" \

      -p mongodb.auth="true" > 1.log

       

      <run>

      ycsb run mongodb -s -P ycsb-0.14.0/workloads/workloada \

      -p operationcount=200000-threads 8 \

      -p mongodb.url="[mongodb://sysbench:mongobench@localhost:20011/mongoycsb]" \

      -p mongodb.auth="true" > 2.log

       

      <3.4.14-load>

      [OVERALL], RunTime(ms), 301149
      [OVERALL], Throughput(ops/sec), 3320.615376441562
      [TOTAL_GCS_Copy], Count, 1615
      [TOTAL_GC_TIME_Copy], Time(ms), 2290
      [TOTAL_GC_TIME_%_Copy], Time(%), 0.7604209212051177
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 1615
      [TOTAL_GC_TIME], Time(ms), 2290
      [TOTAL_GC_TIME_%], Time(%), 0.7604209212051177
      [CLEANUP], Operations, 4
      [CLEANUP], AverageLatency(us), 2934.5
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 11727
      [CLEANUP], 95thPercentileLatency(us), 11727
      [CLEANUP], 99thPercentileLatency(us), 11727
      [INSERT], Operations, 1000000
      [INSERT], AverageLatency(us), 1194.921027
      [INSERT], MinLatency(us), 150
      [INSERT], MaxLatency(us), 410623
      [INSERT], 95thPercentileLatency(us), 2613
      [INSERT], 99thPercentileLatency(us), 12215
      [INSERT], Return=OK, 1000000

      <4.0.0-load>

      [OVERALL], RunTime(ms), 497302
      [OVERALL], Throughput(ops/sec), 2010.8505495654551
      [TOTAL_GCS_Copy], Count, 2230
      [TOTAL_GC_TIME_Copy], Time(ms), 4052
      [TOTAL_GC_TIME_%_Copy], Time(%), 0.8147966426839225
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 2230
      [TOTAL_GC_TIME], Time(ms), 4052
      [TOTAL_GC_TIME_%], Time(%), 0.8147966426839225
      [CLEANUP], Operations, 4
      [CLEANUP], AverageLatency(us), 3123.25
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 12463
      [CLEANUP], 95thPercentileLatency(us), 12463
      [CLEANUP], 99thPercentileLatency(us), 12463
      [INSERT], Operations, 1000000
      [INSERT], AverageLatency(us), 1979.043032
      [INSERT], MinLatency(us), 205
      [INSERT], MaxLatency(us), 604671
      [INSERT], 95thPercentileLatency(us), 4093
      [INSERT], 99thPercentileLatency(us), 6423
      [INSERT], Return=OK, 1000000

       

      <3.4.14-run>

      [OVERALL], RunTime(ms), 71617
      [OVERALL], Throughput(ops/sec), 2792.63303405616
      [TOTAL_GCS_Copy], Count, 464
      [TOTAL_GC_TIME_Copy], Time(ms), 775
      [TOTAL_GC_TIME_%_Copy], Time(%), 1.0821453006967618
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 464
      [TOTAL_GC_TIME], Time(ms), 775
      [TOTAL_GC_TIME_%], Time(%), 1.0821453006967618
      [READ], Operations, 100042
      [READ], AverageLatency(us), 2586.8670658323504
      [READ], MinLatency(us), 152
      [READ], MaxLatency(us), 947711
      [READ], 95thPercentileLatency(us), 11543
      [READ], 99thPercentileLatency(us), 19679
      [READ], Return=OK, 100042
      [CLEANUP], Operations, 8
      [CLEANUP], AverageLatency(us), 864.5
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 6871
      [CLEANUP], 95thPercentileLatency(us), 6871
      [CLEANUP], 99thPercentileLatency(us), 6871
      [UPDATE], Operations, 99958
      [UPDATE], AverageLatency(us), 2993.8426839272493
      [UPDATE], MinLatency(us), 203
      [UPDATE], MaxLatency(us), 947711
      [UPDATE], 95thPercentileLatency(us), 13183
      [UPDATE], 99thPercentileLatency(us), 20975
      [UPDATE], Return=OK, 99958

       

      <4.0.0-run>

      [OVERALL], RunTime(ms), 101728
      [OVERALL], Throughput(ops/sec), 1966.0270525322428
      [TOTAL_GCS_Copy], Count, 588
      [TOTAL_GC_TIME_Copy], Time(ms), 1095
      [TOTAL_GC_TIME_%_Copy], Time(%), 1.076399811261403
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 588
      [TOTAL_GC_TIME], Time(ms), 1095
      [TOTAL_GC_TIME_%], Time(%), 1.076399811261403
      [READ], Operations, 99924
      [READ], AverageLatency(us), 3944.935470957928
      [READ], MinLatency(us), 256
      [READ], MaxLatency(us), 610815
      [READ], 95thPercentileLatency(us), 6835
      [READ], 99thPercentileLatency(us), 15999
      [READ], Return=OK, 99924
      [CLEANUP], Operations, 8
      [CLEANUP], AverageLatency(us), 1130.25
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 9007
      [CLEANUP], 95thPercentileLatency(us), 9007
      [CLEANUP], 99thPercentileLatency(us), 9007
      [UPDATE], Operations, 100076
      [UPDATE], AverageLatency(us), 4064.802370198649
      [UPDATE], MinLatency(us), 287
      [UPDATE], MaxLatency(us), 607743
      [UPDATE], 95thPercentileLatency(us), 7179
      [UPDATE], 99thPercentileLatency(us), 16263
      [UPDATE], Return=OK, 100076

      Attachments

        Activity

          People

            nick.brewer Nick Brewer
            mingyu.lee@linecorp.com lee mingyu
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: