[SERVER-67183] Higher throughput Chunk Migration - reimplement for fetching and insertion Created: 10/Jun/22  Updated: 29/Oct/23  Resolved: 23/Dec/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 5.0.15, 6.3.0-rc0, 6.0.5, 6.0.6

Type: Improvement Priority: Major - P3
Reporter: Rachita Dhawan Assignee: Andrew Witten (Inactive)
Resolution: Fixed Votes: 0
Labels: sharding-nyc-subteam2
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Problem/Incident
causes SERVER-72430 MigrationDestinationManager::report()... Closed
causes SERVER-75939 Fix migration batch inserter log Closed
Related
related to SERVER-81201 Limiting the memory usage during the ... Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v6.1, v6.0, v5.3, v5.0, v4.4
Sprint: Sharding 2022-06-27, Sharding 2022-07-11, Sharding 2022-07-25, Sharding 2022-08-08, Sharding 2022-08-22, Sharding 2022-09-05, Sharding 2022-09-19, Sharding 2022-10-03, Sharding 2022-10-17, Sharding NYC 2022-10-31, Sharding NYC 2022-11-14, Sharding NYC 2022-11-28, Sharding 2022-12-12, Sharding NYC 2022-12-26
Participants:
Linked BF Score: 149

 Description   

Implement multithreaded fetching of chunk migration.



 Comments   
Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Andrew Witten', 'email': 'andrew.witten@mongodb.com', 'username': 'awitten1'}

Message: SERVER-67183 Add parallel fetchers and inserters for chunk migration

(cherry picked from commit 1564f715d16870df7a524ad702aad6be0f2da1f5)
Branch: v6.0
https://github.com/mongodb/mongo/commit/5c398529dcce49b4399e827d18ae683b140e9a11

Comment by Githook User [ 02/Mar/23 ]

Author:

{'name': 'Randolph Tan', 'email': 'randolph@10gen.com', 'username': 'renctan'}

Message: Revert "SERVER-67183 Add parallel fetchers and inserters for chunk migration"

This reverts commit ede7bdea766fff40678d03a7051b0d15de0fbba6.
Branch: v6.0
https://github.com/mongodb/mongo/commit/c9a99c120371d4d4c52cbb15dac34a36ce8d3b1d

Comment by Githook User [ 27/Jan/23 ]

Author:

{'name': 'Randolph Tan', 'email': 'randolph@10gen.com', 'username': 'renctan'}

Message: SERVER-67183 Add parallel fetchers and inserters for chunk migration

(cherry picked from commit ede7bdea766fff40678d03a7051b0d15de0fbba6)
Branch: v5.0
https://github.com/mongodb/mongo/commit/b3e6c678652c8756abc00e80f3c447af054142bb

Comment by Githook User [ 23/Jan/23 ]

Author:

{'name': 'Andrew Witten', 'email': 'andrew.witten@mongodb.com', 'username': 'awitten1'}

Message: SERVER-67183 Add parallel fetchers and inserters for chunk migration

(cherry picked from commit 1564f715d16870df7a524ad702aad6be0f2da1f5)
Branch: v6.0
https://github.com/mongodb/mongo/commit/ede7bdea766fff40678d03a7051b0d15de0fbba6

Comment by Andrew Witten (Inactive) [ 23/Dec/22 ]

I didn't mark this as needing downstream attention because it is behind a feature flag.  But it will at some point need attention.

Comment by Githook User [ 23/Dec/22 ]

Author:

{'name': 'Andrew Witten', 'email': 'andrew.witten@mongodb.com', 'username': 'awitten1'}

Message: SERVER-67183 Add parallel fetchers and inserters for chunk migration
Branch: master
https://github.com/mongodb/mongo/commit/1564f715d16870df7a524ad702aad6be0f2da1f5

Generated at Thu Feb 08 06:07:29 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.