Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-34987

Unable to start standalone MongoDB instance due to checksum mismatch in WiredTiger storage engine

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Critical - P2 Critical - P2
    • None
    • Affects Version/s: 3.4.0
    • Component/s: WiredTiger
    • Labels:
      None
    • ALL

      I have a standalone MongoDB instance. It was working fine till today. When I tried to restart the DB, I am getting error saying there is a checksum mismatch in the WiredTiger.wt file. I dont know the exact reason as to why the data got corrupted. 

       I tried to repair the DB but to no avail. I am getting the same error. I also tried the wiredtiger tool at http://source.wiredtiger.com/3.0.0/command_line.html. But it is also giving the same error.

      It seems there are a lot of such corruption issues and it was being said that the issue would not occur post 3.2 version. I am having 3.4.0 version and still getting the issue.

      I am attaching the required files and any help to recover the data would be deeply appreciated.

      Please feel free to ask me anything else that would be required.

      Please find below the errors (IT IS GIVING DIFFERENT CHECKSUMS AT DIFFERENT TIME OF RESTART EVEN THOUGH NOTHING IN THE DB HAS BEEN CHANGED) -

      1ST TIME OF RESTART

      2018-05-13T17:03:39.809+0530 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=3313M,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2018-05-13T17:03:39.830+0530 E STORAGE [initandlisten] WiredTiger error (0) [1526211219:830804][593:0x7f97fc28dc80]file:WiredTiger.wt, connection: read checksum error for 4096B block at offset 24576: block header checksum of 1793761607 doesn't match expected checksum of 3070115156
      2018-05-13T17:03:39.830+0530 E STORAGE [initandlisten] WiredTiger error (0) [1526211219:830842][593:0x7f97fc28dc80]file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value
      2018-05-13T17:03:39.830+0530 E STORAGE [initandlisten] WiredTiger error (-31804) [1526211219:830860][593:0x7f97fc28dc80]file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic
      2018-05-13T17:03:39.830+0530 I - [initandlisten] Fatal Assertion 28558 at src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp 361
      2018-05-13T17:03:39.830+0530 I - [initandlisten]

      ***aborting after fassert() failure

      2018-05-13T17:03:39.850+0530 F - [initandlisten] Got signal: 6 (Aborted).

       

      2ND TIME OF RESTART

      2018-05-13T23:03:29.765+0530 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=3313M,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2018-05-13T23:03:29.785+0530 E STORAGE [initandlisten] WiredTiger error (0) [1526232809:785143][20203:0x7f32ca8fbc80]file:WiredTiger.wt, connection: read checksum error for 4096B block at offset 24576: block header checksum of 1793761607 doesn't match expected checksum of 1666091971
      2018-05-13T23:03:29.785+0530 E STORAGE [initandlisten] WiredTiger error (0) [1526232809:785225][20203:0x7f32ca8fbc80]file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value
      2018-05-13T23:03:29.785+0530 E STORAGE [initandlisten] WiredTiger error (-31804) [1526232809:785278][20203:0x7f32ca8fbc80]file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic
      2018-05-13T23:03:29.785+0530 I - [initandlisten] Fatal Assertion 28558 at src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp 361
      2018-05-13T23:03:29.785+0530 I - [initandlisten]

      ***aborting after fassert() failure

      2018-05-13T23:03:29.806+0530 F - [initandlisten] Got signal: 6 (Aborted).

            Assignee:
            kelsey.schubert@mongodb.com Kelsey Schubert
            Reporter:
            devapplicate@gmail.com Dev
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: