Investigate/fix memory error with opt off and 1000 FilterNodes

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Won't Fix
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Query Optimization
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      In SERVER-83839 it was found that when we have a pipeline with a large number of match expressions, and pipeline optimization disabled, as well as the query knob introduced in that ticket enabled (so we don't have Filter -> Sargable node rewrites) this results in a memory error during optimization because we generate one FilterNode per DocumentSourceMatch (when pipeline opt is off, we don't merge the stages).

      This should not be a bug in practice, since we run with optimization enabled outside of testing environments; however, this could turn out to be an issue during fuzzer testing. Furthermore, the optimizer probably should not be reliant on pipeline optimization occurring in order to obtain correct results.

      Furtehrmore, if some other mechanism for generating a large number of filter nodes exists, this would actually be an issue.

            Assignee:
            [DO NOT USE] Backlog - Query Optimization
            Reporter:
            Alya Berciu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: