[SERVER-66462] Change stream pre-image write performance degrades under certain conditions Created: 13/May/22  Updated: 29/Oct/23  Resolved: 23/Jun/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: 6.0.0-rc5
Fix Version/s: 6.0.0-rc11, 6.1.0-rc0

Type: Bug Priority: Major - P3
Reporter: Mindaugas Malinauskas Assignee: Mindaugas Malinauskas
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
Problem/Incident
Related
related to SERVER-67786 CollectionScan stage triggers redunda... Closed
related to SERVER-67473 Support insert operations for implici... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v6.0
Sprint: QE 2022-05-30, QE 2022-06-13, QE 2022-06-27
Participants:
Linked BF Score: 35

 Description   

Update/delete operation throughput can severely (>10x) decrease when the change stream pre-images are enabled and more than one collection with change stream pre-images enabled is/has been active in terms of updates/deletes performed. 
The problem manifests almost always in throughput/latency change stream with pre-images tests. The impact can be seen on the second and subsequent test runs within a task. There is some randomness aspect caused by random assignment of unique ids to collections. The test sample in which the problem manifests: 15_whenAvailablefdbc_preImage_1c_avg_latency.
 



 Comments   
Comment by Githook User [ 23/Jun/22 ]

Author:

{'name': 'Mindaugas Malinauskas', 'email': 'mindaugas.malinauskas@mongodb.com'}

Message: SERVER-66462 Fixed change stream pre-image write performance issue
Branch: davish/SERVER-63099
https://github.com/mongodb/mongo/commit/043545f8259aa5c0a4c2fc318ec889d96e54f1ea

Comment by Githook User [ 23/Jun/22 ]

Author:

{'name': 'Mindaugas Malinauskas', 'email': 'mindaugas.malinauskas@mongodb.com'}

Message: SERVER-66462 Fixed change stream pre-image write performance issue

(cherry picked from commit 043545f8259aa5c0a4c2fc318ec889d96e54f1ea)
Branch: v6.0
https://github.com/mongodb/mongo/commit/47da65ec2bb4048ce14176bcbb7ac646021fa97f

Comment by Githook User [ 23/Jun/22 ]

Author:

{'name': 'Mindaugas Malinauskas', 'email': 'mindaugas.malinauskas@mongodb.com'}

Message: SERVER-66462 Fixed change stream pre-image write performance issue
Branch: master
https://github.com/mongodb/mongo/commit/043545f8259aa5c0a4c2fc318ec889d96e54f1ea

Generated at Thu Feb 08 06:05:30 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.