Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-23980

$graphLookup should spill to disk if allowDiskUse is specified

    XMLWordPrintableJSON

Details

    • Query Execution
    • Fully Compatible
    • Query 2017-01-23

    Description

      $graphLookup should spill to disk when the size of the frontier and the visited set exceeds the maximum memory usage. In particular, DocumentSourceGraphLookUp::checkMemoryUsage() should be modified to spill if the size of the two data structures is too large. Second, any place where the frontier or visited set is iterated will need to be updated to use a file iterator if it has spilled to disk.

      Attachments

        Issue Links

          depends on

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-23725 Implement $graphLookup.

          • Major - P3 - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. SERVER-38632 allowDiskUse(true) does not work as expected

          • Major - P3 - Major loss of function.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-74370 100MB stage memory limit for $graphLookup stage limits usability

          • Major - P3 - Major loss of function.
          • Needs Scheduling

          Activity

            People

              backlog-query-execution Backlog - Query Execution
              benjamin.murphy Benjamin Murphy
              Votes:
              23 Vote for this issue
              Watchers:
              35 Start watching this issue

              Dates

                Created:
                Updated: