XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Admin, Concurrency
    • Labels:
      None
    • Operating System:
      ALL

      Description

      I have tested  with the ycsb tool  in MongoDB 3.4.14 and MongoDB  4.0.0
      of course, 2 MongoDB instances are the same architecture ( H/W, OS,  mongo conf)
      and MongoDB  is a replica set (3 members per instance)

      I expected MongoDB 4.0.0 better performance then 4.0.0, but as below results, 3.4.14 is better then 4.0.0

      can you teach me how to test correctly?
      otherwise is this result is right?

       

      1)  used tool (https://github.com/brianfrankcooper/YCSB/releases/download/0.14.0/ycsb-0.14.0.tar.gz)

      2) test script

      <load>

      ycsb load mongodb -s -P ycsb-0.14.0/workloads/workloada \

      -p recordcount=1000000 -threads 4 \

      -p mongodb.url="[mongodb://sysbench:mongobench@localhost:20011/mongoycsb]" \

      -p mongodb.auth="true" > 1.log

       

      <run>

      ycsb run mongodb -s -P ycsb-0.14.0/workloads/workloada \

      -p operationcount=200000-threads 8 \

      -p mongodb.url="[mongodb://sysbench:mongobench@localhost:20011/mongoycsb]" \

      -p mongodb.auth="true" > 2.log

       

      <3.4.14-load>

      [OVERALL], RunTime(ms), 301149
      [OVERALL], Throughput(ops/sec), 3320.615376441562
      [TOTAL_GCS_Copy], Count, 1615
      [TOTAL_GC_TIME_Copy], Time(ms), 2290
      [TOTAL_GC_TIME_%_Copy], Time(%), 0.7604209212051177
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 1615
      [TOTAL_GC_TIME], Time(ms), 2290
      [TOTAL_GC_TIME_%], Time(%), 0.7604209212051177
      [CLEANUP], Operations, 4
      [CLEANUP], AverageLatency(us), 2934.5
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 11727
      [CLEANUP], 95thPercentileLatency(us), 11727
      [CLEANUP], 99thPercentileLatency(us), 11727
      [INSERT], Operations, 1000000
      [INSERT], AverageLatency(us), 1194.921027
      [INSERT], MinLatency(us), 150
      [INSERT], MaxLatency(us), 410623
      [INSERT], 95thPercentileLatency(us), 2613
      [INSERT], 99thPercentileLatency(us), 12215
      [INSERT], Return=OK, 1000000

      <4.0.0-load>

      [OVERALL], RunTime(ms), 497302
      [OVERALL], Throughput(ops/sec), 2010.8505495654551
      [TOTAL_GCS_Copy], Count, 2230
      [TOTAL_GC_TIME_Copy], Time(ms), 4052
      [TOTAL_GC_TIME_%_Copy], Time(%), 0.8147966426839225
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 2230
      [TOTAL_GC_TIME], Time(ms), 4052
      [TOTAL_GC_TIME_%], Time(%), 0.8147966426839225
      [CLEANUP], Operations, 4
      [CLEANUP], AverageLatency(us), 3123.25
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 12463
      [CLEANUP], 95thPercentileLatency(us), 12463
      [CLEANUP], 99thPercentileLatency(us), 12463
      [INSERT], Operations, 1000000
      [INSERT], AverageLatency(us), 1979.043032
      [INSERT], MinLatency(us), 205
      [INSERT], MaxLatency(us), 604671
      [INSERT], 95thPercentileLatency(us), 4093
      [INSERT], 99thPercentileLatency(us), 6423
      [INSERT], Return=OK, 1000000

       

      <3.4.14-run>

      [OVERALL], RunTime(ms), 71617
      [OVERALL], Throughput(ops/sec), 2792.63303405616
      [TOTAL_GCS_Copy], Count, 464
      [TOTAL_GC_TIME_Copy], Time(ms), 775
      [TOTAL_GC_TIME_%_Copy], Time(%), 1.0821453006967618
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 464
      [TOTAL_GC_TIME], Time(ms), 775
      [TOTAL_GC_TIME_%], Time(%), 1.0821453006967618
      [READ], Operations, 100042
      [READ], AverageLatency(us), 2586.8670658323504
      [READ], MinLatency(us), 152
      [READ], MaxLatency(us), 947711
      [READ], 95thPercentileLatency(us), 11543
      [READ], 99thPercentileLatency(us), 19679
      [READ], Return=OK, 100042
      [CLEANUP], Operations, 8
      [CLEANUP], AverageLatency(us), 864.5
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 6871
      [CLEANUP], 95thPercentileLatency(us), 6871
      [CLEANUP], 99thPercentileLatency(us), 6871
      [UPDATE], Operations, 99958
      [UPDATE], AverageLatency(us), 2993.8426839272493
      [UPDATE], MinLatency(us), 203
      [UPDATE], MaxLatency(us), 947711
      [UPDATE], 95thPercentileLatency(us), 13183
      [UPDATE], 99thPercentileLatency(us), 20975
      [UPDATE], Return=OK, 99958

       

      <4.0.0-run>

      [OVERALL], RunTime(ms), 101728
      [OVERALL], Throughput(ops/sec), 1966.0270525322428
      [TOTAL_GCS_Copy], Count, 588
      [TOTAL_GC_TIME_Copy], Time(ms), 1095
      [TOTAL_GC_TIME_%_Copy], Time(%), 1.076399811261403
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 588
      [TOTAL_GC_TIME], Time(ms), 1095
      [TOTAL_GC_TIME_%], Time(%), 1.076399811261403
      [READ], Operations, 99924
      [READ], AverageLatency(us), 3944.935470957928
      [READ], MinLatency(us), 256
      [READ], MaxLatency(us), 610815
      [READ], 95thPercentileLatency(us), 6835
      [READ], 99thPercentileLatency(us), 15999
      [READ], Return=OK, 99924
      [CLEANUP], Operations, 8
      [CLEANUP], AverageLatency(us), 1130.25
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 9007
      [CLEANUP], 95thPercentileLatency(us), 9007
      [CLEANUP], 99thPercentileLatency(us), 9007
      [UPDATE], Operations, 100076
      [UPDATE], AverageLatency(us), 4064.802370198649
      [UPDATE], MinLatency(us), 287
      [UPDATE], MaxLatency(us), 607743
      [UPDATE], 95thPercentileLatency(us), 7179
      [UPDATE], 99thPercentileLatency(us), 16263
      [UPDATE], Return=OK, 100076

        Attachments

          Activity

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: