Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-18927

Bound all memory usage by the agg pipeline

    XMLWordPrintableJSON

Details

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Major - P3 Major - P3
    • None
    • None
    • Aggregation Framework
    • Query Execution

    Description

      Aggregation should bound total memory usage for each pipeline, not like each individual stage. Using multiple stages that can each use up to 100MBs can result in overall very large memory usage.

      Original Description:
      The agg framework should bound all memory usage, not just the sort stage. Using very large amounts of data in $group stage, for instance, can result in 26G of non-mapped virtual memory for a single agg job.

      Attachments

        Activity

          People

            backlog-query-execution Backlog - Query Execution
            charlie.page@10gen.com Charlie Page
            Votes:
            0 Vote for this issue
            Watchers:
            18 Start watching this issue

            Dates

              Created:
              Updated: