Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-46562

Shard Crashes with out of memory

    • Type: Icon: Bug Bug
    • Resolution: Community Answered
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: MapReduce
    • None
    • Fully Compatible
    • ALL

      Hi

      We face an issue when we do many map reduce operations on a sharded cluster.
      The used memory increases more and more and when it is on the limit of the host memory, the mongod process crashes with an out of memry exception.

      Environment:

      • 24 shards, 80 GByte RAM each
      • Default value for storage.wiredTiger.engineConfig.cacheSizeGB (no value set in the config)
      • Continuous parallel running map reduce operations on different input and output collections (Java applicaton with 10 threads)

      We believe that the memory can be used by mongo up to the max availabe RAM. 
      But the mongod process should never crash.

      Many thank for a feedback!

       

        1. image-2020-03-11-01-14-31-322.png
          103 kB
          Rui Ribeiro
        2. image-2020-03-30-14-40-23-844.png
          101 kB
          Rui Ribeiro

            Assignee:
            dmitry.agranat@mongodb.com Dmitry Agranat
            Reporter:
            hermann.jaun@comfone.com Hermann Jaun
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated:
              Resolved: