Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-49223

Suggestions to speed up initial sync

XMLWordPrintableJSON

    • Type: Icon: Improvement Improvement
    • Resolution: Incomplete
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 4.2.8
    • Component/s: None
    • Labels:
      None

      I have a 5TB, 2 collection instance that I need to move from zlib to zstd.  The initial sync is painfully slow right now on a very beefy secondary instance (m5.12xlarge, 192GB of RAM, 48vCPUs).  The initial sync is scheduled to be completed in 8 days.

       

      Primary instance is on an even beefier machine with no load.  I tried diagnosing the slowdown and determined

       - disk is not saturated with iostat

       - cpu is not saturated with htop.  

       - changing instance type to increase/decrease RAM 

       - played around with maxIndexBuildMemoryUsageMegabytes with setParameter

       - played around with replWriterThreadCount with setParameter

       

      It seems like the instance can do a lot more with disk + CPU not saturated on both the primary and the secondary.  Is there anything else I can try?

            Assignee:
            dmitry.agranat@mongodb.com Dmitry Agranat
            Reporter:
            oliver@sensortower.com Oliver Yeh
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: