[SERVER-67699] Add tracking for when change stream event exceeds 16Mb Created: 30/Jun/22  Updated: 29/Oct/23  Resolved: 22/Mar/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.0.0-rc0, 6.0.7, 5.0.19

Type: Task Priority: Major - P3
Reporter: Katya Kamenieva Assignee: Romans Kasperovics
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
is depended on by TOOLS-3274 Investigate changes in SERVER-67699: ... Closed
Documented
is documented by DOCS-15974 [Server] Add tracking for when change... Closed
Problem/Incident
Related
related to SERVER-55062 Change stream events can exceed 16MB ... Closed
related to SERVER-65093 Count operation failures in serverSta... Open
Assigned Teams:
Query Execution
Backwards Compatibility: Fully Compatible
Backport Requested:
v6.3, v6.0, v5.0, v4.4
Sprint: QE 2023-03-06, QE 2023-03-20, QE 2023-04-03
Participants:
Linked BF Score: 155

 Description   

Add counter to the db.serverStatus() output when change stream encounters the BSONObjectTooLarge error.
The new counter (NumberLong) is located under metrics.changeStreams.largeEventsSplit.

Add counter to the db.serverStatus() output when the new $changeStreamSplitLargeEvent stage splits the event.
The new counter (NumberLong) is located under metrics.changeStreams.largeEventsFailed.



 Comments   
Comment by Githook User [ 11/Jul/23 ]

Author:

{'name': 'Serhii Lysenko', 'email': 'serhii.lysenko@mongodb.com', 'username': 'serhiitea'}

Message: SERVER-71828 Add $changeStreamSplitLargeEvent stage

This change is a part of PM-2677 backport.
It includes the following changes:

Comment by Githook User [ 20/Jun/23 ]

Author:

{'name': 'Serhii Lysenko', 'email': 'serhii.lysenko@mongodb.com', 'username': 'serhiitea'}

Message: SERVER-67699 Add change stream large event metrics

Backport the changeStreamsLargeEventsFailedCounter metric.

This change is a part of PM-2677 backport.
Branch: v5.0
https://github.com/mongodb/mongo/commit/7a3da53d603617a6811e104f46086028f49c61d0

Comment by Githook User [ 12/Jun/23 ]

Author:

{'name': 'Serhii Lysenko', 'email': 'serhii.lysenko@mongodb.com', 'username': 'serhiitea'}

Message: SERVER-67699 Implement changeStreamsLargeEventsFailedCounter
Branch: v6.0
https://github.com/mongodb/mongo/commit/d25648f6a959c025b80f077b4b08b6c5eda8b89a

Comment by Githook User [ 21/Mar/23 ]

Author:

{'name': 'Romans Kasperovics', 'email': 'romans.kasperovics@mongodb.com', 'username': 'romanskas'}

Message: SERVER-67699 Add change stream large event metrics
Branch: master
https://github.com/mongodb/mongo/commit/d8c1a8abfdcf737392b520e64d762043d1469b3e

Comment by Githook User [ 20/Mar/23 ]

Author:

{'name': 'Sviatlana Zuiko', 'email': 'sviatlana.zuiko@mongodb.com', 'username': 'szuiko'}

Message: Revert "SERVER-67699 Add change stream large event metrics"

This reverts commit cfef97a4f1a377613ba264eb648bb175ca5a2216.
Branch: master
https://github.com/mongodb/mongo/commit/598ebfee8e441253efed2ee4118ec8a045f75479

Comment by Githook User [ 20/Mar/23 ]

Author:

{'name': 'Romans Kasperovics', 'email': 'romans.kasperovics@mongodb.com', 'username': 'romanskas'}

Message: SERVER-67699 Add change stream large event metrics
Branch: master
https://github.com/mongodb/mongo/commit/cfef97a4f1a377613ba264eb648bb175ca5a2216

Comment by Ana Meza [ 05/Jul/22 ]

kateryna.kamenieva@mongodb.com bernard.gorman@mongodb.com we are adding this one to Quick wins but lets us know if we need to implement it sooner

Generated at Thu Feb 08 06:08:49 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.