Stages that spill using the file based spiller update the sort spilling counters

    • Type: Bug
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Query Execution
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      The current sort spilling counters are unreliable for assessing sort performance when an aggregation includes stages that spill via FileBasedSorter. This is because these counters are incorrectly incremented when stages call the shared addAlreadySorted method. To accurately reflect sort-specific performance, the logic for updating the sort spilling counters must be moved outside of the common addAlreadySorted method and into a path exclusive to sorting operations.

      The following stages all update the sort spilling counters

      • Sort
      • Group
      • Lookup hash join
      • SetWindowFields
      • GeoNear
      • TextOr
      • BucketAuto
      • GraphLookup

            Assignee:
            Unassigned
            Reporter:
            Foteini Alvanaki
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: