Take cost of SORT spilling into account

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Unresolved
    • Priority: Major - P3
    • 8.3.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Query Optimization
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      We currently don't take memory consumption into account for the SORT node. We've noticed however that we can severely underestimate the cost of a SORT stage, because it might spill data to disk in case of large inputs.

      One idea might be to look at the threshold for when we spill to disk. Then, you could estimate the needed spills by looking at average document size & input cardinality.

            Assignee:
            Max Verbinnen
            Reporter:
            Max Verbinnen
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated: