[SERVER-29141] Add sharding support for merging changeNotification responses from all shards Created: 11/May/17  Updated: 30/Oct/23  Resolved: 09/Oct/17

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 3.6.0-rc0

Type: Task Priority: Major - P3
Reporter: Crystal Horn Assignee: Charlie Swanson
Resolution: Fixed Votes: 0
Labels: todo_in_code
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
depends on SERVER-29929 Report highest observed cluster time ... Closed
depends on SERVER-22760 Sharded aggregation pipelines which i... Closed
depends on SERVER-30704 Use the AsyncResultsMerger to merge r... Closed
Duplicate
is duplicated by SERVER-30198 Support resumeAfter option to $change... Closed
is duplicated by SERVER-31179 Make sure change streams on sharded c... Closed
is duplicated by SERVER-29604 Error when resuming change notificati... Closed
Related
related to SERVER-43500 Complete TODO listed in SERVER-29141 Closed
related to SERVER-44220 Complete TODO listed in SERVER-29141 Closed
Backwards Compatibility: Fully Compatible
Sprint: Repl 2017-08-21, Repl 2017-09-11, Repl 2017-10-02, Repl 2017-10-23
Participants:

 Description   

The streams should be merged in order of the 'resumeToken' field of the change notification entries



 Comments   
Comment by Githook User [ 10/Oct/17 ]

Author:

{'email': 'max.hirschhorn@mongodb.com', 'name': 'Max Hirschhorn', 'username': 'visemet'}

Message: SERVER-29141 Remove blacklist entry for resume_change_stream.js.

The test was deleted in 47084f8ce0df808f7b26dd1c9a6344179fe8628b, so
we'll want to add this blacklist entry back in once the test's spurious
failures are addressed.
Branch: master
https://github.com/mongodb/mongo/commit/dd094ce1bc1fb424ccc6dd71939e5c7a30159e2e

Comment by Githook User [ 10/Oct/17 ]

Author:

{'email': 'kaloian.manassiev@mongodb.com', 'name': 'Kaloian Manassiev', 'username': 'kaloianm'}

Message: SERVER-29141 Fix lint error
Branch: master
https://github.com/mongodb/mongo/commit/63a1ed132fce92bca57845879f4bb25e44c92874

Comment by Githook User [ 09/Oct/17 ]

Author:

{'email': 'charlie.swanson@mongodb.com', 'name': 'Charlie Swanson', 'username': 'cswanson310'}

Message: SERVER-29141 Temporarily remove test causing spurious failures
Branch: master
https://github.com/mongodb/mongo/commit/47084f8ce0df808f7b26dd1c9a6344179fe8628b

Comment by Charlie Swanson [ 09/Oct/17 ]

This functionality has been added, but there is remaining debugging work to be done to hunt down a race causing test failures (resume_change_stream.js has been temporarily disabled), tracked by SERVER-31475.

Comment by Githook User [ 09/Oct/17 ]

Author:

{'email': 'charlie.swanson@mongodb.com', 'name': 'Charlie Swanson', 'username': 'cswanson310'}

Message: SERVER-29141 Enable change streams on sharded collections
Branch: master
https://github.com/mongodb/mongo/commit/4f17acbd9ca2ba9b91a4c72813fcb413146cfdcf

Comment by Githook User [ 04/Oct/17 ]

Author:

{'email': 'bernard.gorman@gmail.com', 'name': 'Bernard Gorman', 'username': 'gormanb'}

Message: SERVER-29141 Extend StageConstraints to allow kLocalOnly and kMongos host requirements, given pipeline split state
Branch: master
https://github.com/mongodb/mongo/commit/939f2bcda18db41b774bbe3cf16e1d4928c58e5d

Comment by Githook User [ 26/Sep/17 ]

Author:

{'email': 'bernard.gorman@gmail.com', 'name': 'Bernard Gorman', 'username': 'gormanb'}

Message: SERVER-29141 Update AsyncResultsMerger to merge multiple change streams
Branch: master
https://github.com/mongodb/mongo/commit/5c29ce7718b423ae23ba0eccf71249cf69d36d37

Comment by Githook User [ 26/Sep/17 ]

Author:

{'email': 'bernard.gorman@gmail.com', 'name': 'Bernard Gorman', 'username': 'gormanb'}

Message: SERVER-29141 Refactor the way mongos handles tailable awaitData cursors
Branch: master
https://github.com/mongodb/mongo/commit/b3b44c1ecd30adaf7421ef9c93a237693a1fca06

Comment by Githook User [ 25/Sep/17 ]

Author:

{'email': 'bernard.gorman@gmail.com', 'name': 'Bernard Gorman', 'username': 'gormanb'}

Message: SERVER-29141 Add latest oplog timestamp to CursorResponse object
Branch: master
https://github.com/mongodb/mongo/commit/7777de09e8fde5c3ecd6e9d4cbec4f2b0e9c6a52

Comment by Githook User [ 18/Sep/17 ]

Author:

{'username': 'cswanson310', 'name': 'Charlie Swanson', 'email': 'charlie.swanson@mongodb.com'}

Message: SERVER-29141 Add a waitForEvent with a timeout to TaskExecutor.
Branch: master
https://github.com/mongodb/mongo/commit/29faa71a0bdf07a1c9af09cf33e2953d816de1cf

Comment by Githook User [ 18/Sep/17 ]

Author:

{'username': 'cswanson310', 'name': 'Charlie Swanson', 'email': 'charlie.swanson@mongodb.com'}

Message: SERVER-29141 Clean up change stream tests' cursors
Branch: master
https://github.com/mongodb/mongo/commit/b394a689561bc35f5e75ff1b6eef2e4fe1ddd512

Comment by Charlie Swanson [ 12/Jul/17 ]

spencer will do, waiting to see how the linked tickets turned out, then I'll develop a plan and break it up into more digestible pieces if appropriate.

Comment by Charlie Swanson [ 12/Jul/17 ]

I'm going to tentatively move this to next sprint, since it depends on some other work that I've now linked. Seems optimistic to think this will be done by the end of the sprint.

Generated at Thu Feb 08 04:20:00 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.