Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-56237

Degraded performance on ARM AWS Graviton2 instances compared with x86_64 architecture

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Major - P3
    • Resolution: Done
    • 4.4.5
    • None
    • None
    • ALL
      1. Deploy 2 mongodb databases, one on ARM AWS server, the second one on x86_64 arch
      2. Make ARM server primary
      3. Put many concurrent load there, notice 100% load
      4. Switch primary to x86_64, notice reduced load

    Description

      We migrated our mongodb server from AWS r5d.16xlarge to r6gd.16xlarge (Intel Xeon Platinum 8000  -> AWS Graviton 2) and faced with significant performance degradation.

      Performance degrades in case of many parallel queries of any nature (we noticed degradation on aggregation/distinct/filter queries, so, don't assume that issue is related to kind of query)

      On the screenshot below red metrics for two same databases in the one ReplicaSet, the green one is ARM(r6gd.16xlarge), the yellow one is x86_64(r5d.16xlarge), the vertical red bar is the point to a time when we switched primaries (from ARM to x86_64). Our clients reading only from primaries. How you can see, under the same kind of load produce 100% load on the ARM server but ~10% load on the x86_64 server. Load is constant within a day.

      Attachments

        1. image-2021-04-30-19-10-21-812.png
          image-2021-04-30-19-10-21-812.png
          12 kB
        2. image-2021-07-20-16-55-27-165.png
          image-2021-07-20-16-55-27-165.png
          357 kB
        3. perf_SERVER-56237.svg
          668 kB
        4. screenshot-1.png
          screenshot-1.png
          110 kB
        5. Screen Shot 2021-04-27 at 16.21.33.png
          Screen Shot 2021-04-27 at 16.21.33.png
          412 kB
        6. Screen Shot 2021-04-27 at 16.21.56.png
          Screen Shot 2021-04-27 at 16.21.56.png
          179 kB

        Issue Links

          Activity

            People

              dmitry.agranat@mongodb.com Dmitry Agranat
              ivan.takarlikov@sensortower.com Ivan Takarlikov
              Votes:
              2 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: