Rename numParallelSpills to maxSpillsPerMerge

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage Execution
    • Storage Execution 2026-03-16, Storage Execution 2026-03-30
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      numParallelSpills (used by mergeSpills) represents the maximum number of spill ranges we merge together in a single merge batch while still respecting the memory limits. From the name alone, it’s easy to misread this as “the number of merges we run in parallel,” which is not what it does. Using a variable name like maxSpillsPerMerge (or similar) would reduce confusion about sorter metrics and for future readers.

            Assignee:
            Shin Yee Tan
            Reporter:
            Shin Yee Tan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: