[SERVER-26924] Cannot start or --repair mongod because of unclean shutdown (due to running out of disk space) Created: 07/Nov/16 Updated: 14/Nov/16 Resolved: 14/Nov/16 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | WiredTiger |
| Affects Version/s: | 3.2.9 |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Ali Punjani | Assignee: | Kelsey Schubert |
| Resolution: | Duplicate | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
||||||||||||||||
| Issue Links: |
|
||||||||||||||||
| Operating System: | ALL | ||||||||||||||||
| Participants: | |||||||||||||||||
| Description |
|
I have a small 1.7GB database that was running fine, but the drive it was on got filled up and so mongod crashed. Subsequently it's impossible to start mongod or to --repair, with the following error:
I believe this means the WiredTiger.wt file is somehow corrupt, seems like there are a lot of other tickets like this and some kind of manual repair needs to be done. I'm attaching all the relavant non-collection/index files from the db, hopefully someone can help! |
| Comments |
| Comment by Kelsey Schubert [ 08/Nov/16 ] | |||||
|
Hi alipunjani, The issue you describe is likely caused by Thank you for taking the time to detail the steps you took to recover your data. I'm glad this resolved the issue for you, however please be aware that the steps you describe may lead to undefined states. We have an open ticket, Kind regards, | |||||
| Comment by Ali Punjani [ 08/Nov/16 ] | |||||
|
I managed to fix this issue myself through a lot of manual labour. For those interested, here's what I did. Based on: 1) Instantiate or find a separate db that has the same collections as the corrupt db (call this the working db) | |||||
| Comment by Ali Punjani [ 08/Nov/16 ] | |||||
|
Enjoy! | |||||
| Comment by Ali Punjani [ 07/Nov/16 ] | |||||
|
Also, for further reference, here is the log from right before the crash showing what happened:
|