Apply writes to spilldb in batches of 16MB in size.

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Fixed
    • Priority: Major - P3
    • 8.2.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage Execution
    • Storage Execution 2025-06-09, Storage Execution 2025-06-23, Storage Execution 2025-07-07
    • None
    • 3
    • TBD
    • None
    • None
    • None
    • None
    • None
    • None

      Spilldb cache is just 100MB in size, we want to ensure that a writer does not occupy too much space in this cache by writing data in very large batches.

      Also, think about how to handle the case when there are 100s of SpillTable concurrently being written.

            Assignee:
            Gregory Noma
            Reporter:
            Sandeep Dhoot
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: