[SERVER-81879] startupRecoveryForRestore can drop tables whose catalog write is not yet checkpointed Created: 04/Oct/23  Updated: 15/Nov/23  Resolved: 15/Nov/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: 5.0.0, 4.4.7
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Gregory Noma Assignee: Gregory Noma
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
duplicates SERVER-80974 Unclean shutdown while dropping local... Closed
Problem/Incident
is caused by SERVER-55766 Introduce an optimized "for restore" ... Closed
Related
related to SERVER-79245 Unclean shutdown while dropping colle... Closed
related to SERVER-81878 startupRecoveryForRestore may not pla... Closed
Assigned Teams:
Storage Execution
Operating System: ALL
Sprint: Execution Team 2023-11-13, Execution Team 2023-11-27
Participants:
Case:

 Description   

When using startupRecoveryForRestore we advance the oldest timestamp during startup oplog recovery, as described in SERVER-55766. This causes the drop-pending ident reaper to run, dropping the tables for any collection/index drops that were applied during the recovery. However, those writes may not have been checkpointed yet. Thus if a crash occurs before a subsequent checkpoint, we may end up in a state where the catalog references a table which no longer exists in the storage engine.



 Comments   
Comment by Gregory Noma [ 15/Nov/23 ]

This is describing a specific case of the same issue described in SERVER-80974 so I am closing as a duplicate of that ticket

Comment by Gregory Noma [ 15/Nov/23 ]

This should already be fixed in versions newer than 5.0 thanks to SERVER-80974

Comment by Steven Vannelli [ 05/Oct/23 ]

This should be investigated alongside SERVER-81878 and we should still look into which branches this affects.

We think the implementation used in SERVER-80974 could be leveraged here

Generated at Thu Feb 08 06:47:39 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.