Implement 'merging' expressions for accumulators

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Won't Fix
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      In addition to the accumulators 'accumulate' and 'finalize' steps, we'll need a way to 'merge' two accumulated states. This is necessary to implement a naive version of spilling (via sorted files or unsorted files) as well as sharding.

      Support for this should be added to the stage builder for accumulators.

            Assignee:
            Yoon Soo Kim (Inactive)
            Reporter:
            Ian Boros
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: