[SERVER-27725] Use batch insert when migrating chunks Created: 17/Jan/17  Updated: 23/Nov/22  Resolved: 20/Jul/18

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: 3.4.17, 3.6.7, 4.0.2, 4.1.1

Type: Improvement Priority: Major - P3
Reporter: Daniel Pasette (Inactive) Assignee: Cheahuychou Mao
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
depends on SERVER-35849 Remove dependency of the write comman... Closed
Duplicate
is duplicated by SERVER-22196 Sharding migrateClone phase should us... Closed
Related
related to SERVER-32885 Overlap chunk clone application on th... Closed
related to SERVER-37080 Implement tuneable batch size for chu... Closed
is related to SERVER-8835 _secondaryThrottle should GLE after e... Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v4.0, v3.6, v3.4
Sprint: Sharding 2017-12-04, Sharding 2018-07-02, Sharding 2018-07-16, Sharding 2018-07-30
Participants:
Case:
Linked BF Score: 0

 Description   

We currently upsert one document at a time in the receive portion of chunk migration. We should be able to batch insert documents and fall back to one-at-a-time if there is an error. This should be a performance win, but needs to be tested.



 Comments   
Comment by Githook User [ 29/Aug/18 ]

Author:

{'name': 'Kaloian Manassiev', 'email': 'kaloian.manassiev@mongodb.com', 'username': 'kaloianm'}

Message: SERVER-27725 Use batch insert when migrating chunks

(cherry picked from commit b20b8c2a6930a43004c776f011212af2f2fcd59a)
Branch: v3.4
https://github.com/mongodb/mongo/commit/f49d4876eca3341f6c0539b8525598e31a590748

Comment by Githook User [ 29/Aug/18 ]

Author:

{'name': 'Kaloian Manassiev', 'email': 'kaloian.manassiev@mongodb.com', 'username': 'kaloianm'}

Message: SERVER-27725 Do not perform orphan check while doing range deletion as part of chunk receive
Branch: v3.4
https://github.com/mongodb/mongo/commit/0a30697f653ab8a58b509a52ef0c8337c90c7552

Comment by Githook User [ 08/Aug/18 ]

Author:

{'name': 'Cheahuychou Mao', 'email': 'cheahuychou.mao@mongodb.com', 'username': 'cheahuychou'}

Message: SERVER-27725 Use batch insert when migrating chunks

(cherry picked from commit b20b8c2a6930a43004c776f011212af2f2fcd59a)
Branch: v3.6
https://github.com/mongodb/mongo/commit/1ba1423693a268d3b40b56da9d23600b393a31e3

Comment by Githook User [ 08/Aug/18 ]

Author:

{'username': 'cheahuychou', 'name': 'Cheahuychou Mao', 'email': 'cheahuychou.mao@mongodb.com'}

Message: SERVER-27725 Use batch insert when migrating chunks

(cherry picked from commit b20b8c2a6930a43004c776f011212af2f2fcd59a)
Branch: v4.0
https://github.com/mongodb/mongo/commit/c058773ffdfda6416afcd30953b9ddb2b43d353c

Comment by Githook User [ 20/Jul/18 ]

Author:

{'name': 'Cheahuychou Mao', 'email': 'cheahuychou.mao@mongodb.com', 'username': 'cheahuychou'}

Message: SERVER-27725 Use batch insert when migrating chunks
Branch: master
https://github.com/mongodb/mongo/commit/b20b8c2a6930a43004c776f011212af2f2fcd59a

Generated at Thu Feb 08 04:16:01 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.