[SERVER-60982] Evaluate the performance of the new migration protocol Created: 26/Oct/21  Updated: 15/Nov/21  Resolved: 15/Nov/21

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Sergi Mateo Bellido Assignee: Jordi Serra Torrens
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
depends on SERVER-60984 Report time in recipient critical sec... Closed
Related
related to SERVER-58991 Acquire the critical section on the r... Closed
Sprint: Sharding EMEA 2021-11-01, Sharding EMEA 2021-11-15
Participants:

 Description   

The goal of this task is to evaluate the performance impact of acquiring the critical section on the recipient as part of the new migration protocol.

More specifically, we would like to know:

  1. How long are we holding the CS on the donor and recipient compared to the previous implementation.
  2. Impact of the optimization proposed by Andy on the technical design document (i.e. skipping one hop).
  3. Are we overlapping the execution of the refresh of the filtering information on the donor with the one on the recipient?

The proposed workload is to create a sharded collection with N chunks: N-1 chunks will be empty except one that will have some data (Q: should it be an input of the workload? IMO it could be interesting but not at the beginning).  Once everything is properly set up, the workload should move this chunk from the donor shard to another shard and get some metrics. We will repeat this process M times.

Some considerations:

  • The baseline of the comparison should be master without our changes (i.e. we are going to compare the old migration protocol against the new one). We can take 5.2 without the feature flag, so we don't have any problem with the recent changes we did on the chunksize.

Generated at Thu Feb 08 05:51:14 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.