Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-46562

Shard Crashes with out of memory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major - P3
    • Resolution: Community Answered
    • None
    • None
    • MapReduce
    • None
    • Fully Compatible
    • ALL

    Description

      Hi

      We face an issue when we do many map reduce operations on a sharded cluster.
      The used memory increases more and more and when it is on the limit of the host memory, the mongod process crashes with an out of memry exception.

      Environment:

      • 24 shards, 80 GByte RAM each
      • Default value for storage.wiredTiger.engineConfig.cacheSizeGB (no value set in the config)
      • Continuous parallel running map reduce operations on different input and output collections (Java applicaton with 10 threads)

      We believe that the memory can be used by mongo up to the max availabe RAM. 
      But the mongod process should never crash.

      Many thank for a feedback!

       

      Attachments

        1. image-2020-03-11-01-14-31-322.png
          103 kB
          Rui Ribeiro
        2. image-2020-03-30-14-40-23-844.png
          101 kB
          Rui Ribeiro

        Activity

          People

            dmitry.agranat@mongodb.com Dmitry Agranat
            hermann.jaun@comfone.com Hermann Jaun
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: