Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-27666

listDatabases performance issue w/ replicasets & wiredTiger

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Replication, WiredTiger
    • Labels:
      None
    • Operating System:
      ALL
    • Steps To Reproduce:
      1. Create 100s of databases with 100s of collections and dozens of indexes on each collection, totaling over 250,000 files (if on SSD. spinning drives may require less)
      2. Enable a replicaset
      3. (or just run show dbs)

      Description

      Each of the non-primary replica members appears to be asking the primary every minute for a "listDatabases". Since each requests takes about 2 seconds, every minute or so, we'll see our members lag on sync, because of this.

      While some performance issues were fixed in SERVER-17078, the overall problem of time to return has not. Obviously with more than 250,000 files in our wiredTiger directory, one might expect it would take a bit of time to count the sizes.

      I would suggest creating a listDatabases (like) method that did not get file and index sizes. This would be used for whatever purposes the replicasets require, without creating the massive requests to the filesystem and delays in synchronization

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              mark.agarunov Mark Agarunov
              Reporter:
              sallgeud Chad Kreimendahl
              Participants:
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: