Loading...

XML

Word

Printable

JSON

Type: Improvement
Resolution: Fixed
Priority: Major - P3
Fix Version/s: 5.1.0-rc0
Affects Version/s: None
Component/s: None
Labels:
None

Backwards Compatibility:
Minor Change
Backport Requested:

v5.0
Sprint:
Query Execution 2021-05-31, Query Execution 2021-06-14, Query Execution 2021-06-28, Query Execution 2021-07-12, Query Execution 2021-07-26, QE 2021-08-09
Confidence Status:
None
Work Order:
3

Aha! Reference:
None
Tracking Level:
None
Risk Status:
None
Exec Notes:
None
Goal Name:
None
Goal Link:
None

This optimization function will recognize when a $match applies directly to the output of a $changeStream and construct the additional filters that make it safe to apply $match predicates to the oplog entry without the risk of filtering out transactions or applyOps events.

There will also be infrastructure to apply the needed rewrites to fields in the $match so that predicates can be applied for oplog entries, but the rewrites themselves will be implemented in future tickets.

depends on

SERVER-54677 Serialization and deserialization for change streams lookup stages

Closed

SERVER-54676 Serialization and deserialization for shard-side change streams stages

Closed

SERVER-54937 Remove DocumentSourceChangeStreamCloseCursor dependency on invalidate events

Closed

SERVER-55534 Store original pipeline in DocumentSourceUpdateOnAddShard for dispatch to new shards

Closed

SERVER-56871 Allow $match and $project to swap with $_internalUpdateOnAddShard and $_internalEnsureResumeTokenPresent

Closed

is depended on by

SERVER-55540 Optimization to apply $match filters on "clusterTime" field before DocumentSourceChangeStreamTransform

Closed

SERVER-55541 Add "ns" to fields eligible for $match optimization in change streams pipelines

Closed

SERVER-55542 Add "operationType" to fields eligible for $match optimization in change streams pipelines

Closed

SERVER-55543 Improve change stream $match pushdown to work for "lsid" and "txnNumber" fields

Closed

SERVER-55544 Add "to" field to fields eligible for $match optimization in change streams pipelines

Closed

is duplicated by

SERVER-55543 Improve change stream $match pushdown to work for "lsid" and "txnNumber" fields

Closed

is related to

SERVER-58857 Change stream accidentally filters out rename event from reshardCollection [5.0 Only]

Closed

related to

SERVER-90297 Empty field match expression causes change stream optimization rewrite failure

Closed

SERVER-55535 Performance tests to exercise change streams optimizations

Closed

SERVER-55539 Allow $match filter based on mod of timestamp to participate in split for optimization

Closed

(5 is depended on by, 1 is duplicated by, 1 is related to, 3 related to)

Assignee:: Justin Seyster
Reporter:: Justin Seyster
Participants:: Githook User, Justin Seyster, Vivian Ge
Votes:: 0 Vote for this issue
Watchers:: 5 Start watching this issue

Created:: May 12 2021 12:00:22 AM UTC
Updated:: May 14 2024 06:57:11 PM UTC
Resolved:: Aug 04 2021 12:08:14 AM UTC
Confidence Status Last Update:: 18/May/21 3:42 PM

Details

Description

Attachments

Issue Links

Activity

People

Dates