[SERVER-50117] Write and test aggregation pipeline for iterating oplog buffer collections Created: 05/Aug/20  Updated: 29/Oct/23  Resolved: 26/Aug/20

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: 4.7.0

Type: Task Priority: Major - P3
Reporter: Max Hirschhorn Assignee: Randolph Tan
Resolution: Fixed Votes: 0
Labels: PM-234-M2, PM-234-T-oplog-apply
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Gantt Dependency
has to be done before SERVER-50118 Create oplog buffer iterator for resh... Closed
Backwards Compatibility: Fully Compatible
Sprint: Sharding 2020-09-07
Participants:

 Description   

The goal of this ticket is to create a function which allows the aggregation pipeline to easily be run locally on the (recipient) shard and for the aggregation pipeline to be unit-testable with DocumentSourceMock. It is preferable to use DocumentSourceXX::create() functions (or DocumentSourceXX::parseFromBSON() when the former isn't available or is too tedious) rather than building it up with string concatenation. DocumentSources can be conditionally added to the Pipeline::SourceContainer, for example, to reflect a stage being added only when resuming on a new cursor.

std::unique_ptr<Pipeline, PipelineDeleter> createOplogBufferIteratingPipelineForResharding(
    BSONObj startAfter,  /* expected to be an object of the form {_id: {clusterTime: <Timestamp>, ts: <Timestamp>}} or isEmpty() */
);



 Comments   
Comment by Githook User [ 26/Aug/20 ]

Author:

{'name': 'Randolph Tan', 'email': 'randolph@10gen.com', 'username': 'renctan'}

Message: SERVER-50117 Add resumeToken and pre/post image oplog tests for createAggForReshardingOplogBuffer
Branch: master
https://github.com/mongodb/mongo/commit/a60b31413da02569d9e6e682da3ebf0ae6cc4107

Comment by Githook User [ 17/Aug/20 ]

Author:

{'name': 'Randolph Tan', 'email': 'randolph@10gen.com', 'username': 'renctan'}

Message: SERVER-50117 Implement pipeline for iterating over donor oplog entries
Branch: master
https://github.com/mongodb/mongo/commit/534031f397c801d860eab4866053422b74d1ab3c

Generated at Thu Feb 08 05:21:46 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.