Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-5087

reduce required memory for aggregation steps by freeing data that has been returned by $group and $sort

    XMLWordPrintableJSON

Details

    • Icon: Improvement Improvement
    • Resolution: Duplicate
    • Icon: Major - P3 Major - P3
    • None
    • None
    • Aggregation Framework
    • None

    Description

      $group and $sort must take in all their input before they can produce a result.

      At present, when the output is produced, it is simply scrolled over by the DocumentSource. We could start freeing values that have been returned by these sources as they are returned. This may be more noticeable (allow more processing) when more than one $group and/or $sort appear in the same pipeline – documents will flow from one to the next, requiring a constant amount of memory, instead of accumulating in each aggregator in the pipeline.

      Attachments

        Activity

          People

            mathias@mongodb.com Mathias Stearn
            dan@mongodb.com Daniel Pasette (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: