[SERVER-59078] Implement 'merging' expressions for accumulators Created: 03/Aug/21 Updated: 13/Oct/21 Resolved: 13/Oct/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Ian Boros | Assignee: | Yoon Soo Kim |
| Resolution: | Won't Fix | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Participants: |
| Description |
|
In addition to the accumulators 'accumulate' and 'finalize' steps, we'll need a way to 'merge' two accumulated states. This is necessary to implement a naive version of spilling (via sorted files or unsorted files) as well as sharding. Support for this should be added to the stage builder for accumulators. |
| Comments |
| Comment by Eric Cox (Inactive) [ 13/Oct/21 ] |
|
Closing since the spilling implementation can do without this. |