Apply writes to spilldb in batches of 16MB in size.

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Fixed
    • Priority: Major - P3
    • 8.2.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage Execution
    • Storage Execution 2025-06-09, Storage Execution 2025-06-23, Storage Execution 2025-07-07
    • None
    • 3
    • TBD
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Spilldb cache is just 100MB in size, we want to ensure that a writer does not occupy too much space in this cache by writing data in very large batches.

      Also, think about how to handle the case when there are 100s of SpillTable concurrently being written.

              Assignee:
              Gregory Noma
              Reporter:
              Sandeep Dhoot
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: