Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-31155

High memory & resources usage + very long boot time with many DBs

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Duplicate
    • Affects Version/s: 3.4.6
    • Fix Version/s: None
    • Component/s: WiredTiger
    • Labels:
      None
    • Environment:
      Ubuntu 16.04

      Description

      When using a lot of DBs (few thousands) mongod process take a lot of time to boot (minutes) and takes a lot of system resources afterwards.
      Until boot is complete (minutes) the DB doesn't accept client connections.

      It open all storage files (one per every collection and per index in every DB) + consumes a lot of memory. For 2000 DBs with 10 collections and 5 indexes per collection, there will be 100000 open file handlers.

      On our use-case, we keep the DBs but access them rarely, usually only few DBs are relevant at any given moment.

      I would expect mongo to lazy load the DBs when first connection is made.
      (and hopefully unload if no active connection for a while)

      Assaf

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              kelsey.schubert Kelsey T Schubert
              Reporter:
              assaf-oren assaf-oren
              Participants:
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: