Suggestions to speed up initial sync

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Incomplete
    • Priority: Major - P3
    • None
    • Affects Version/s: 4.2.8
    • Component/s: None
    • None
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      I have a 5TB, 2 collection instance that I need to move from zlib to zstd.  The initial sync is painfully slow right now on a very beefy secondary instance (m5.12xlarge, 192GB of RAM, 48vCPUs).  The initial sync is scheduled to be completed in 8 days.

       

      Primary instance is on an even beefier machine with no load.  I tried diagnosing the slowdown and determined

       - disk is not saturated with iostat

       - cpu is not saturated with htop.  

       - changing instance type to increase/decrease RAM 

       - played around with maxIndexBuildMemoryUsageMegabytes with setParameter

       - played around with replWriterThreadCount with setParameter

       

      It seems like the instance can do a lot more with disk + CPU not saturated on both the primary and the secondary.  Is there anything else I can try?

              Assignee:
              Dmitry Agranat
              Reporter:
              Oliver Yeh
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: