Details
-
Investigation
-
Resolution: Done
-
Major - P3
-
None
-
None
-
None
-
Not Needed
Description
StorE may introduce a new oplog entry
Description of Linked Ticket
Summary
Use WiredTiger truncation to delete data on change stream pre/post-images collections and Serverless change collections.
Motivation
MongoDB maintains internal collections that contain full or partial copies of user data. These collections support features such as pre/post-images for change streams and per-tenant change streams for Serverless. These new collections multiply the amount of data we must insert and delete on each node. Unfortunately, deleting old data is still costly and slow despite improvements made in PM-2227. As a result the tasks that purge expired data may not be able to delete data faster than new data is inserted, which risks clusters running out of disk space.
WiredTiger has a truncation API that efficiently deletes large ranges of data without having to read everything from disk. Use this new API on these internal collections to delete data.
Documentation
[Scope Document|]
[Technical Design Document|]
[Product Description|]