Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-16699

degrading update performance

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • 3.0.0-rc6
    • Affects Version/s: 2.8.0-rc4
    • Component/s: Storage, WiredTiger
    • None
    • Fully Compatible
    • ALL
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      I update large collection (~500gb snappy compressed data) on non-sharded environment. I split collection into chunks using splitVector, 32mb per chunk. Then I perform some analysis on each record and update each record (add one small field). At the start everething is cool, performance comparable to TokuMX which I used earlier. But then performance degrades rapidly. You can find plots of some metrices attached. It is very strange that disk is not fully utilized, but cpu utilized at 100%.
      My db hosted on ec2 r3.4xlarge machine. Disks - 2 * 1TB ebs combined into raid0.

        1. 1-CPU.png
          1-CPU.png
          41 kB
        2. 2-disk-read.png
          2-disk-read.png
          54 kB
        3. 3-disk-write.png
          3-disk-write.png
          69 kB
        4. 4-disk-idle.png
          4-disk-idle.png
          72 kB
        5. 5-update-time-per-chunk.png
          5-update-time-per-chunk.png
          63 kB
        6. sysmon.py
          2 kB

            Assignee:
            bruce.lucas@mongodb.com Bruce Lucas (Inactive)
            Reporter:
            dselivanov Dmitriy Selivanov
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: