[SERVER-32913] Parallelize application of applyOps oplog entries Created: 25/Jan/18  Updated: 30/Oct/23  Resolved: 21/Feb/18

Status: Closed
Project: Core Server
Component/s: Replication
Affects Version/s: None
Fix Version/s: 3.7.3

Type: Task Priority: Major - P3
Reporter: Spencer Brody (Inactive) Assignee: Benety Goh
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Related
related to SERVER-32935 improve exception handling in SyncTai... Closed
related to SERVER-33509 inconsistent treatment of applyOps du... Closed
related to SERVER-33618 Initial sync should consider applyOps... Closed
related to SERVER-33160 syncApply() treatment of delete opera... Closed
is related to SERVER-32346 When applying applyOps commands durin... Closed
is related to SERVER-32338 Update secondary oplog application ma... Closed
Backwards Compatibility: Fully Compatible
Sprint: Repl 2018-02-12, Repl 2018-02-26
Participants:
Linked BF Score: 0

 Comments   
Comment by Githook User [ 21/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 batch applyOps with other CRUD operations when reading from oplog buffer
Branch: master
https://github.com/mongodb/mongo/commit/b83a7ff0178b8a6a43d8903deb8084604b147a4a

Comment by Githook User [ 21/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 SyncTail::tryPopAndWaitForMore() no longer needs to handle oplog entries on system.indexes
Branch: master
https://github.com/mongodb/mongo/commit/298dae8fed97e950b2633c32829ccd85bad204f1

Comment by Githook User [ 21/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 fassert if we fail to extract applyOps operations during oplog application
Branch: master
https://github.com/mongodb/mongo/commit/7d5ce53b98749ca4978e7c54a2b3280ef549df89

Comment by Githook User [ 20/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 applyOps containing malformed operations cannot run atomically
Branch: master
https://github.com/mongodb/mongo/commit/9c988ee4d574e401b4e02f480d2758d76af9aec7

Comment by Githook User [ 20/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 ApplyOps::extractOperations on applyOps with no ops returns empty array instead of throwing exception
Branch: master
https://github.com/mongodb/mongo/commit/f20e0181324386f6c9d0f0c2e5eef6b3a64995c6

Comment by Githook User [ 16/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 remove unnecessary reference to 'valueB' in applyOperation_inlock()

Delete operations in this context, which uses the _id as criteria, always remove just one document.
Branch: master
https://github.com/mongodb/mongo/commit/7aaacb4e7ce9ca7f3883679283ea095ea8d363eb

Comment by Githook User [ 16/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 doTxn rejects malformed operations
Branch: master
https://github.com/mongodb/mongo/commit/0b879318cf23418cf9e0a27b399e41c468fb6662

Comment by Githook User [ 16/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 added 'b' (upsert) field to ReplOperation IDL
Branch: master
https://github.com/mongodb/mongo/commit/baf801ac03422414ca0bf9f44daac6cacc520177

Comment by Githook User [ 15/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 clean up StorageTimestampTest applyOps operations
Branch: master
https://github.com/mongodb/mongo/commit/176ddcc24a12a041d09b805f71f59a56d3710c0e

Comment by Githook User [ 13/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 parallelize application of applyOps oplog entries
Branch: master
https://github.com/mongodb/mongo/commit/ca0a855dfc0f479d85b76a640b12a259c0547310

Comment by Githook User [ 08/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 add ApplyOpsCommandInfo

This consolidates the command option parsing and some metadata for the applyOps command.
Branch: master
https://github.com/mongodb/mongo/commit/2e287a4bc99f3c774a5322eae477f626638c6a81

Comment by Githook User [ 06/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 add ApplyOps::extractOperations

This function extracts the embedded CRUD operations from an atomic applyOps
oplog entry into multiple CRUD oplog entries.
Branch: master
https://github.com/mongodb/mongo/commit/4d3d82ed0342b207a719f8f37b3821059a8dc210

Comment by Githook User [ 03/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 remove unused repl writer thread count default for 32-bit platforms
Branch: master
https://github.com/mongodb/mongo/commit/17e5f0903e9880a70d4679ae5e4fcbad861370fc

Comment by Githook User [ 02/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 move applyOps() into repl namespace
Branch: master
https://github.com/mongodb/mongo/commit/abd5c6a75aa3883f3d8c6065d1d4f23160723829

Comment by Githook User [ 02/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 split SyncTail::fillWriterVectorsAndLatestSessionRecords() into fillWriterVectors() and getLatestSessionRecords()
Branch: master
https://github.com/mongodb/mongo/commit/488709dde37d13d42321b5ad8989331960602b53

Comment by Githook User [ 01/Feb/18 ]

Author:

{'email': 'benety@mongodb.com', 'name': 'Benety Goh', 'username': 'benety'}

Message: SERVER-32913 add namespace to applyOperation_inlock dassert message for lock error
Branch: master
https://github.com/mongodb/mongo/commit/a646512fa6c2d3f3d4ef2fe8dd6cc5f5af15d1a3

Generated at Thu Feb 08 04:31:41 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.