[SERVER-75005] Integrate pre-image collection removal with new truncate mechanism Created: 17/Mar/23  Updated: 29/Oct/23  Resolved: 11/May/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.1.0-rc0

Type: Improvement Priority: Major - P3
Reporter: Jordi Olivares Provencio Assignee: Haley Connelly
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
depends on SERVER-75006 Add method to fully update read-copy-... Closed
depends on WT-10949 Allow truncate operation with no time... Closed
Gantt Dependency
has to be done after SERVER-76125 Make ChangeStreamPreImagesCollectionM... Closed
Related
is related to WT-10887 Add a table configuration indicating ... Closed
Backwards Compatibility: Fully Compatible
Sprint: Execution Team 2023-04-03, Execution Team 2023-04-17, Execution Team 2023-05-01, Execution Team 2023-05-15
Participants:

 Description   

As the implementation of Pre-image truncate markers gets merged. We want to start work on integrating them with the existing asynchronous remover process.

To this end, the following steps should guarantee proper initialisation:

  • Inserters can create the CollectionTruncateMarkers instance if it doesn't exist
  • Remover will start by scanning the pre-image collection and creating the CollectionTruncateMarkers instance

At this point the invariant of all pre-image collections present in the map will always hold.

  • Remover will then sample the collection
  • Remover will then block modifications of the map and perform the following:
    • Create a set of initial truncate markers for each collection in the map based on the samples
    • Replace the CollectionTruncateMarkers with a new instance containing the new set of initial markers for each collection
  • Remover will then mark itself as having initialised the map.

With this series of steps we'll be able to guarantee that the map is fully initialised with proper metrics for all collections and without blocking anything except momentarily halting inserts to new collections that use pre-images.



 Comments   
Comment by Githook User [ 10/May/23 ]

Author:

{'name': 'Haley Connelly', 'email': 'haley.connelly@mongodb.com', 'username': 'haleyConnelly'}

Message: SERVER-75005 Integrate pre-image collection removal with new truncate mechanism
Branch: master
https://github.com/mongodb/mongo/commit/42feb6abe211d0e071b794db8e7566ff8bdd4c42

Generated at Thu Feb 08 06:29:05 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.