Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-16773

Performance degradation due to TCMalloc scalability

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • 2.8.0-rc4
    • 3.0.0-rc7
    • Performance, Storage
    • None
    • Mongodb using the TCMalloc memory allocator.
    • Fully Compatible
    • ALL

    Description

      Performance degradation due to TCMalloc scalability with very large number of threads. After a few minutes of running with hundreds of threads, the large majority of CPU time is spent scavenging memory. As this often occurs in critical sections, system throughput may degrade by an order of magnitude or more. Increasing the TCMalloc thread cache to its maximum of 1 GB does not avoid this problem. Using the system allocator does, but costs performance in most other cases.

      Attachments

        1. MMAP-26.csv.ops.png
          MMAP-26.csv.ops.png
          202 kB
        2. MMAP-28.csv.ops.png
          MMAP-28.csv.ops.png
          255 kB
        3. rc4.png
          rc4.png
          70 kB
        4. WorkloadSuspension.png
          WorkloadSuspension.png
          48 kB

        Issue Links

          is duplicated by

          Task - A task that needs to be done. SERVER-16879 Degraded performance on rc5 (mms-prod-pings1)

          • Critical - P2 - Crashes, loss of data, severe memory leak.
          • Closed
          is related to

          Task - A task that needs to be done. SERVER-22763 Investigate performance of new gperftools upstream MarkThreadTemporarilyIdle

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-31839 Investigate JEMalloc Performance Versus TCMalloc

          • Major - P3 - Major loss of function.
          • Closed
          related to

          Bug - A problem which impairs or prevents the functions of the product. SERVER-16131 Log File Blowing up on sharded ycsb run in EC2 (or inserts too slow)

          • Major - P3 - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-20104 WT high memory usage due to high amount of free memory accumulated by TCMalloc

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-16879 Degraded performance on rc5 (mms-prod-pings1)

          • Critical - P2 - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              eliot Eliot Horowitz (Inactive)
              john.page@mongodb.com John Page
              Votes:
              1 Vote for this issue
              Watchers:
              29 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: