[SERVER-58217] Apply the updates from `_xferMods` in parallel on the recipient Created: 02/Jul/21 Updated: 06/Dec/22 Resolved: 05/Nov/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Sharding |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Kaloian Manassiev | Assignee: | [DO NOT USE] Backlog - Sharding EMEA |
| Resolution: | Won't Do | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||
| Assigned Teams: |
Sharding EMEA
|
||||||||
| Participants: | |||||||||
| Description |
|
Currently, the recipient applies the updates from the `_xferMods` command sequentially, which increases the latency for processing a batch. This in turn results in slower throughput for migrations. We should make it so that the updates are applied in parallel. |
| Comments |
| Comment by Kaloian Manassiev [ 05/Nov/21 ] |
|
From the performance evaluation of migrations of large chunks we have confirmed that the improvements done so far (increasing the batch size and overlapping application of xferMods with fetching them) is sufficient, so we will not be proceeding with this work. |