[SERVER-32378] Mongodb failed to start after a disk 100% full problem Created: 17/Dec/17 Updated: 27/Jul/18 Resolved: 19/Dec/17 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | WiredTiger |
| Affects Version/s: | 3.2.7 |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | wang yongchao | Assignee: | Mark Agarunov |
| Resolution: | Done | Votes: | 0 |
| Labels: | envns, rdi, rpu, trcf, wtc | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
|||||||||||||||||||||||||||||||||||||||||||||||||||
| Operating System: | Linux | |||||||||||||||||||||||||||||||||||||||||||||||||||
| Steps To Reproduce: |
|
|||||||||||||||||||||||||||||||||||||||||||||||||||
| Participants: |
| Description |
|
My server had a 'No space left on device' problem because our disk was running out of inode early today. |
| Comments |
| Comment by Mark Agarunov [ 19/Dec/17 ] |
|
Hello aquilx, Unfortunately, this error indicates that there was corruption on the disk, most often cause by a faulty storage layer. In this situation, our best recommendation would be to resync the affected node or restore from a backup if possible. To prevent this type of problem in the future please take note of the following guidelines to help mitigate any issues related to unreliable storage layers or server failures.
Thanks, |
| Comment by wang yongchao [ 19/Dec/17 ] |
|
Hello Mark, Thanks, |
| Comment by Mark Agarunov [ 18/Dec/17 ] |
|
Hello aquilx, Thank you for your report. I've attached a repair attempt of the files you provided. Please extract these files and replace them in your $dbpath and let us know if it resolves the issue. If you are still seeing errors after replacing these files, please provide the complete logs from the affected node(s) so that we can further investigate. Thanks, |