Loading...

XML

Word

Printable

JSON

Type: Improvement
Resolution: Fixed
Priority: Major - P3
Fix Version/s: 5.1.0-rc0
Affects Version/s: None
Component/s: None
Labels:
None

Backwards Compatibility:
Minor Change
Backport Requested:

v5.0
Sprint:
Query Execution 2021-05-31, Query Execution 2021-06-14, Query Execution 2021-06-28, Query Execution 2021-07-12, Query Execution 2021-07-26, QE 2021-08-09

This optimization function will recognize when a $match applies directly to the output of a $changeStream and construct the additional filters that make it safe to apply $match predicates to the oplog entry without the risk of filtering out transactions or applyOps events.

There will also be infrastructure to apply the needed rewrites to fields in the $match so that predicates can be applied for oplog entries, but the rewrites themselves will be implemented in future tickets.

depends on

SERVER-54677 Serialization and deserialization for change streams lookup stages

Closed

SERVER-54676 Serialization and deserialization for shard-side change streams stages

Closed

SERVER-54937 Remove DocumentSourceChangeStreamCloseCursor dependency on invalidate events

Closed

SERVER-55534 Store original pipeline in DocumentSourceUpdateOnAddShard for dispatch to new shards

Closed

SERVER-56871 Allow $match and $project to swap with $_internalUpdateOnAddShard and $_internalEnsureResumeTokenPresent

Closed

is depended on by

SERVER-55540 Optimization to apply $match filters on "clusterTime" field before DocumentSourceChangeStreamTransform

Closed

SERVER-55541 Add "ns" to fields eligible for $match optimization in change streams pipelines

Closed

SERVER-55542 Add "operationType" to fields eligible for $match optimization in change streams pipelines

Closed

SERVER-55543 Improve change stream $match pushdown to work for "lsid" and "txnNumber" fields

Closed

SERVER-55544 Add "to" field to fields eligible for $match optimization in change streams pipelines

Closed

is duplicated by

SERVER-55543 Improve change stream $match pushdown to work for "lsid" and "txnNumber" fields

Closed

is related to

SERVER-58857 Change stream accidentally filters out rename event from reshardCollection [5.0 Only]

Closed

related to

SERVER-55535 Performance tests to exercise change streams optimizations

Closed

SERVER-55539 Allow $match filter based on mod of timestamp to participate in split for optimization

Closed

(5 is depended on by, 1 is duplicated by, 1 is related to, 2 related to)

Assignee:: Justin Seyster

Reporter:: Justin Seyster

Participants:: Githook User, Justin Seyster, Vivian Ge

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Created:: May 12 2021 12:00:22 AM UTC

Updated:: Oct 29 2023 09:53:42 PM UTC

Resolved:: Aug 04 2021 12:08:14 AM UTC

Details

Description

Attachments

Issue Links

Activity

People

Dates