[SERVER-42826] WireTiger.turtle corruption after mongo instance died. Created: 15/Aug/19  Updated: 28/Aug/19  Resolved: 28/Aug/19

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: 3.4.9
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Steve Froehlich Assignee: Kelsey Schubert
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File WiredTiger.turtle     File WiredTiger.wt     File repair_attempt.tar.gz    
Operating System: ALL
Steps To Reproduce:

I attached the WiredTiger.turtle and WiredTiger.wt files, which are the files with the corrupted meta data

Participants:

 Description   

After a node ran out of physical space the mongo instance died. After adding more space to the drive we noticed 

E STORAGE [thread2] WiredTiger error (0) [1565637801:350365][71742:0x7fcd5869b700], file:WiredTiger.wt, WT_SESSION.checkpoint: WiredTiger.turtle: encountered an illegal file format or internal value

and

Fatal Assertion 28558 at src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp 361

The instance was running on

Red Hat Enterprise Linux Server release 7.6 (Maipo) on native hardware (not a VM)

We tried running the repair utility but the same error was observed while trying to run repair.



 Comments   
Comment by Steve Froehlich [ 23/Aug/19 ]

Ok Thanks. I'll give it a shot.

Comment by Kelsey Schubert [ 21/Aug/19 ]

Hi steve.froehlich@cmegroup.com,

I've attached a repair attempt of the files you provided as repair_attempt.tar.gz. Please extract these files, replace them in your $dbpath, and let us know if it resolves the issue.

Thank you,
Kelsey

Generated at Thu Feb 08 05:01:32 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.