XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Admin, Concurrency
    • Labels:
      None
    • Operating System:
      ALL

      Description

      I have tested  with the ycsb tool  in MongoDB 3.4.14 and MongoDB  4.0.0
      of course, 2 MongoDB instances are the same architecture ( H/W, OS,  mongo conf)
      and MongoDB  is a replica set (3 members per instance)

      I expected MongoDB 4.0.0 better performance then 4.0.0, but as below results, 3.4.14 is better then 4.0.0

      can you teach me how to test correctly?
      otherwise is this result is right?

       

      1)  used tool (https://github.com/brianfrankcooper/YCSB/releases/download/0.14.0/ycsb-0.14.0.tar.gz)

      2) test script

      <load>

      ycsb load mongodb -s -P ycsb-0.14.0/workloads/workloada \

      -p recordcount=1000000 -threads 4 \

      -p mongodb.url="[mongodb://sysbench:mongobench@localhost:20011/mongoycsb]" \

      -p mongodb.auth="true" > 1.log

       

      <run>

      ycsb run mongodb -s -P ycsb-0.14.0/workloads/workloada \

      -p operationcount=200000-threads 8 \

      -p mongodb.url="[mongodb://sysbench:mongobench@localhost:20011/mongoycsb]" \

      -p mongodb.auth="true" > 2.log

       

      <3.4.14-load>

      [OVERALL], RunTime(ms), 301149
      [OVERALL], Throughput(ops/sec), 3320.615376441562
      [TOTAL_GCS_Copy], Count, 1615
      [TOTAL_GC_TIME_Copy], Time(ms), 2290
      [TOTAL_GC_TIME_%_Copy], Time(%), 0.7604209212051177
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 1615
      [TOTAL_GC_TIME], Time(ms), 2290
      [TOTAL_GC_TIME_%], Time(%), 0.7604209212051177
      [CLEANUP], Operations, 4
      [CLEANUP], AverageLatency(us), 2934.5
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 11727
      [CLEANUP], 95thPercentileLatency(us), 11727
      [CLEANUP], 99thPercentileLatency(us), 11727
      [INSERT], Operations, 1000000
      [INSERT], AverageLatency(us), 1194.921027
      [INSERT], MinLatency(us), 150
      [INSERT], MaxLatency(us), 410623
      [INSERT], 95thPercentileLatency(us), 2613
      [INSERT], 99thPercentileLatency(us), 12215
      [INSERT], Return=OK, 1000000

      <4.0.0-load>

      [OVERALL], RunTime(ms), 497302
      [OVERALL], Throughput(ops/sec), 2010.8505495654551
      [TOTAL_GCS_Copy], Count, 2230
      [TOTAL_GC_TIME_Copy], Time(ms), 4052
      [TOTAL_GC_TIME_%_Copy], Time(%), 0.8147966426839225
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 2230
      [TOTAL_GC_TIME], Time(ms), 4052
      [TOTAL_GC_TIME_%], Time(%), 0.8147966426839225
      [CLEANUP], Operations, 4
      [CLEANUP], AverageLatency(us), 3123.25
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 12463
      [CLEANUP], 95thPercentileLatency(us), 12463
      [CLEANUP], 99thPercentileLatency(us), 12463
      [INSERT], Operations, 1000000
      [INSERT], AverageLatency(us), 1979.043032
      [INSERT], MinLatency(us), 205
      [INSERT], MaxLatency(us), 604671
      [INSERT], 95thPercentileLatency(us), 4093
      [INSERT], 99thPercentileLatency(us), 6423
      [INSERT], Return=OK, 1000000

       

      <3.4.14-run>

      [OVERALL], RunTime(ms), 71617
      [OVERALL], Throughput(ops/sec), 2792.63303405616
      [TOTAL_GCS_Copy], Count, 464
      [TOTAL_GC_TIME_Copy], Time(ms), 775
      [TOTAL_GC_TIME_%_Copy], Time(%), 1.0821453006967618
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 464
      [TOTAL_GC_TIME], Time(ms), 775
      [TOTAL_GC_TIME_%], Time(%), 1.0821453006967618
      [READ], Operations, 100042
      [READ], AverageLatency(us), 2586.8670658323504
      [READ], MinLatency(us), 152
      [READ], MaxLatency(us), 947711
      [READ], 95thPercentileLatency(us), 11543
      [READ], 99thPercentileLatency(us), 19679
      [READ], Return=OK, 100042
      [CLEANUP], Operations, 8
      [CLEANUP], AverageLatency(us), 864.5
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 6871
      [CLEANUP], 95thPercentileLatency(us), 6871
      [CLEANUP], 99thPercentileLatency(us), 6871
      [UPDATE], Operations, 99958
      [UPDATE], AverageLatency(us), 2993.8426839272493
      [UPDATE], MinLatency(us), 203
      [UPDATE], MaxLatency(us), 947711
      [UPDATE], 95thPercentileLatency(us), 13183
      [UPDATE], 99thPercentileLatency(us), 20975
      [UPDATE], Return=OK, 99958

       

      <4.0.0-run>

      [OVERALL], RunTime(ms), 101728
      [OVERALL], Throughput(ops/sec), 1966.0270525322428
      [TOTAL_GCS_Copy], Count, 588
      [TOTAL_GC_TIME_Copy], Time(ms), 1095
      [TOTAL_GC_TIME_%_Copy], Time(%), 1.076399811261403
      [TOTAL_GCS_MarkSweepCompact], Count, 0
      [TOTAL_GC_TIME_MarkSweepCompact], Time(ms), 0
      [TOTAL_GC_TIME_%_MarkSweepCompact], Time(%), 0.0
      [TOTAL_GCs], Count, 588
      [TOTAL_GC_TIME], Time(ms), 1095
      [TOTAL_GC_TIME_%], Time(%), 1.076399811261403
      [READ], Operations, 99924
      [READ], AverageLatency(us), 3944.935470957928
      [READ], MinLatency(us), 256
      [READ], MaxLatency(us), 610815
      [READ], 95thPercentileLatency(us), 6835
      [READ], 99thPercentileLatency(us), 15999
      [READ], Return=OK, 99924
      [CLEANUP], Operations, 8
      [CLEANUP], AverageLatency(us), 1130.25
      [CLEANUP], MinLatency(us), 1
      [CLEANUP], MaxLatency(us), 9007
      [CLEANUP], 95thPercentileLatency(us), 9007
      [CLEANUP], 99thPercentileLatency(us), 9007
      [UPDATE], Operations, 100076
      [UPDATE], AverageLatency(us), 4064.802370198649
      [UPDATE], MinLatency(us), 287
      [UPDATE], MaxLatency(us), 607743
      [UPDATE], 95thPercentileLatency(us), 7179
      [UPDATE], 99thPercentileLatency(us), 16263
      [UPDATE], Return=OK, 100076

        Attachments

          Activity

            People

            Assignee:
            nick.brewer Nick Brewer
            Reporter:
            ee400 lee mingyu
            Participants:
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: