Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-54791

Excessive file descriptor usage during index build with external sort

    XMLWordPrintableJSON

Details

    • Fully Compatible
    • v5.0, v4.4, v4.2
    • Execution Team 2021-07-12, Execution Team 2021-07-26, Execution Team 2021-08-09
    • 151

    Description

      During the index build phase with the external sort, file descriptor usage can be in thousands or even tens of thousands. This might be problematic for workloads that already consume a significant number of file descriptors or OS's where increasing the equivalent to file descriptors might be a problem.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-50709 Use boost::filesystem::path instead of std::string for file names in Sorter/SortedFileWriter/FileIterator/MergeIterator

          • Minor - P4 - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is related to

          Task - A task that needs to be done. SERVER-64659 Report in serverStatus number of file descriptors used during index builds

          • Major - P3 - Major loss of function.
          • Closed
          related to

          Task - A task that needs to be done. SERVER-64659 Report in serverStatus number of file descriptors used during index builds

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-44984 Reduce index thread pool size and reduce memory used per build

          • Major - P3 - Major loss of function.
          • Closed

          Activity

            People

              gregory.noma@mongodb.com Gregory Noma
              dmitry.agranat@mongodb.com Dmitry Agranat
              Votes:
              6 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: