[SERVER-58218] Apply the deletes from `_xferMods` in parallel on the recipient Created: 02/Jul/21  Updated: 06/Dec/22  Resolved: 05/Nov/21

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Kaloian Manassiev Assignee: [DO NOT USE] Backlog - Sharding EMEA
Resolution: Won't Do Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Gantt Dependency
has to be done after SERVER-58241 Overlap fetching of `_xferMods` from ... Closed
Assigned Teams:
Sharding EMEA
Participants:

 Description   

Currently, the recipient applies the deletes from the `_xferMods` command sequentially, which increases the latency for processing a batch. This in turn results in slower throughput for migrations.

We should make it so that the deletes are applied in parallel.



 Comments   
Comment by Kaloian Manassiev [ 05/Nov/21 ]

From the performance evaluation of migrations of large chunks we have confirmed that the improvements done so far (increasing the batch size and overlapping application of xferMods with fetching them) is sufficient, so we will not be proceeding with this work.

Generated at Thu Feb 08 05:43:55 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.