-
Type: Task
-
Resolution: Won't Fix
-
Priority: Major - P3
-
None
-
Affects Version/s: None
-
Component/s: None
-
Labels:None
In addition to the accumulators 'accumulate' and 'finalize' steps, we'll need a way to 'merge' two accumulated states. This is necessary to implement a naive version of spilling (via sorted files or unsorted files) as well as sharding.
Support for this should be added to the stage builder for accumulators.