Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-16155

After hitting open file limits - WT goes into a loop at shutdown and needs forced kill

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical - P2
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0-rc1
    • Component/s: Storage
    • Labels:
    • Operating System:
      ALL

      Description

      Once WT instance encounters a open files limit for the files on disk, normal shutdown goes into a loop with following errors:

      2014-11-14T10:22:23.938-0500 E STORAGE  [conn1] WiredTiger (0) [1415978543:938879][3539:0x10eff7000], file:WiredTiger.wt, cursor.search: the WiredTiger library cannot continue; the process must exit and restart
      2014-11-14T10:22:23.939-0500 E STORAGE  [conn1] WiredTiger (0) [1415978543:938998][3539:0x10eff7000], file:WiredTiger.wt, cursor.close: the WiredTiger library cannot continue; the process must exit and restart
      2014-11-14T10:22:23.939-0500 E STORAGE  [conn1] WiredTiger (0) [1415978543:939113][3539:0x10eff7000], cursor.set_key: the WiredTiger library cannot continue; the process must exit and restart

      Eventually this needs a hard kill of the process.

      Steps:
      1. Create scenario for running out of file descriptors

       
      for (i = 0; i < 2430; i++) { db.getCollection("coll-" + i).insert({}); } 

      2. db.shutdownServer() or kill <pid>
      3. WT goes into loop needing kill -9

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            anil.kumar Anil Kumar
            Participants:
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: