Misleading spills counters in sort

    • Type: Bug
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Query Execution
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      sortCounters are updated inside SortedFileWriter::writeChunk(), which is called once per kSortedFileBufferSize write buffer flush. A single logical spill event that is triggered when the in-memory buffer reaches a memory limit of 100MB produces ~1600 chunk writes. As a result, spillToDisk overcounts spill events. Sort counters should be incremented once per logical spill. This is done already for the explain output where the spilledRanges are used.

            Assignee:
            Unassigned
            Reporter:
            Foteini Alvanaki
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: