Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-17930

Wired Tiger encountered an illegal file format or internal value

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Critical - P2 Critical - P2
    • None
    • Affects Version/s: 3.0.1
    • Component/s: WiredTiger
    • None
    • ALL
    • Hide

      We simply restarted mongod. Not sure what collection name this relates to.

      Show
      We simply restarted mongod. Not sure what collection name this relates to.

      We are using MongoDB version v3.0.1

      with the following settings in our mongod.conf file

      storageEngine=wiredTiger
      wiredTigerJournalCompressor=zlib
      wiredTigerCollectionBlockCompressor=zlib

      We had the following crash and when we restart MongoD, it soon crashes and not start.

      Any help would be appreciated.

      Here is the crash log:

      2015-04-08T13:10:42.435+0000 E STORAGE  [WiredTigerRecordStoreThread for local.oplog.rs] WiredTiger (0) [1428498642:435502][29420:0x7ff6c66c0700], file:c
      ollection-6-7936355874207802400.wt, cursor.next: zlib error: inflate: data error: -3
      2015-04-08T13:10:42.435+0000 E STORAGE  [WiredTigerRecordStoreThread for local.oplog.rs] WiredTiger (0) [1428498642:435577][29420:0x7ff6c66c0700], file:c
      ollection-6-7936355874207802400.wt, cursor.next: file:collection-6-7936355874207802400.wt: encountered an illegal file format or internal value
      2015-04-08T13:10:42.435+0000 E STORAGE  [WiredTigerRecordStoreThread for local.oplog.rs] WiredTiger (-31804) [1428498642:435604][29420:0x7ff6c66c0700], f
      ile:collection-6-7936355874207802400.wt, cursor.next: the process must exit and restart: WT_PANIC: WiredTiger library panic
      2015-04-08T13:10:42.435+0000 I -        [WiredTigerRecordStoreThread for local.oplog.rs] Fatal Assertion 28558
      2015-04-08T13:10:42.472+0000 I CONTROL  [WiredTigerRecordStoreThread for local.oplog.rs] 
       0xf69059 0xf09851 0xeee3d1 0xd934ca 0x1395a30 0x1395cf5 0x1396194 0x1306e07 0x130b2e5 0x1308683 0x131b9f4 0x12f2d27 0x1337e89 0xd815df 0xd87139 0xef1010
       0xfb65b4 0x7ff6d2debdf3 0x7ff6d189a1ad
      ----- BEGIN BACKTRACE -----
      {"backtrace":[{"b":"400000","o":"B69059"},{"b":"400000","o":"B09851"},{"b":"400000","o":"AEE3D1"},{"b":"400000","o":"9934CA"},{"b":"400000","o":"F95A30"}
      ,{"b":"400000","o":"F95CF5"},{"b":"400000","o":"F96194"},{"b":"400000","o":"F06E07"},{"b":"400000","o":"F0B2E5"},{"b":"400000","o":"F08683"},{"b":"400000
      ","o":"F1B9F4"},{"b":"400000","o":"EF2D27"},{"b":"400000","o":"F37E89"},{"b":"400000","o":"9815DF"},{"b":"400000","o":"987139"},{"b":"400000","o":"AF1010
      "},{"b":"400000","o":"BB65B4"},{"b":"7FF6D2DE4000","o":"7DF3"},{"b":"7FF6D17A4000","o":"F61AD"}],"processInfo":{ "mongodbVersion" : "3.0.1", "gitVersion"
       : "534b5a3f9d10f00cd27737fbcd951032248b5952", "uname" : { "sysname" : "Linux", "release" : "3.14.35-28.38.amzn1.x86_64", "version" : "#1 SMP Wed Mar 11 
      22:50:37 UTC 2015", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "88CB3D538C3BA7BF665064D73361CA4AD39CC200" }, { "b" 
      : "7FFF7B207000", "elfType" : 3, "buildId" : "8DD7A7F645E37D599573A937DBAA3E931F55DE40" }, { "b" : "7FF6D2DE4000", "path" : "/lib64/libpthread.so.0", "el
      fType" : 3, "buildId" : "D48D3E6672A77B603B402F661BABF75E90AD570B" }, { "b" : "7FF6D2B77000", "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId
      " : "F711D67FF0C1FE2222FB003A30AB74DA26A5EF41" }, { "b" : "7FF6D2792000", "path" : "/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "777069F5EECC26CD
      66C5C8390FA2BF4E444979D1" }, { "b" : "7FF6D258A000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "E81013CBFA409053D58A65A0653271AB665A4619" 
      }, { "b" : "7FF6D2386000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "62A8842157C62F95C3069CBF779AFCC26577A99A" }, { "b" : "7FF6D207D000",
       "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3, "buildId" : "66F1CF311C61879639BD3DC0034DEE0D6D042261" }, { "b" : "7FF6D1D7B000", "path" : "/lib64/
      libm.so.6", "elfType" : 3, "buildId" : "5F97F8F8E5024E29717CF35998681F84D4A22D45" }, { "b" : "7FF6D1B65000", "path" : "/lib64/libgcc_s.so.1", "elfType" :
       3, "buildId" : "C52958E393BDF8E8D090F36DE0F4E620D8736FBF" }, { "b" : "7FF6D17A4000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "77E48C0DBA
      E0843560558F1E51A5FC61602ABC5F" }, { "b" : "7FF6D3000000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "6F90843B9087FE91955FEB0355
      EB0858EF9E97B2" }, { "b" : "7FF6D1561000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "72C1DB5E2447A90D1BF34065BCC031B7263FFBAC" }
      , { "b" : "7FF6D127C000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "2B8787E8E0C317CF820E5D830D923BC744E497F4" }, { "b" : "7FF6D1079000"
      , "path" : "/usr/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "622F315EB5CB2F791E9B64020692EBA98195D06D" }, { "b" : "7FF6D0E4E000", "path" : "/lib6
      4/libk5crypto.so.3", "elfType" : 3, "buildId" : "B10FBFEC246C4EAD1719D16090D0BE54904BBFC9" }, { "b" : "7FF6D0C38000", "path" : "/lib64/libz.so.1", "elfTy
      pe" : 3, "buildId" : "89C6AF118B6B4FB6A73AE1813E2C8BDD722956D1" }, { "b" : "7FF6D0A2D000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId
      " : "7292C0673D7C116E3389D3FFA67087A6B9287A71" }, { "b" : "7FF6D082A000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "37A58210FA50C91
      E09387765408A92909468D25B" }, { "b" : "7FF6D0610000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "17295EFA7A45ADE184C2A7A3294460BDC8B43
      277" }, { "b" : "7FF6D03EF000", "path" : "/usr/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "F5054DC94443326819FBF3065CFDF5E4726F57EE" } ] }}
       mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf69059]
       mongod(_ZN5mongo10logContextEPKc+0xE1) [0xf09851]
       mongod(_ZN5mongo13fassertFailedEi+0x61) [0xeee3d1]
       mongod(+0x9934CA) [0xd934ca]
       mongod(+0xF95A30) [0x1395a30]
       mongod(__wt_err+0x95) [0x1395cf5]
       mongod(__wt_panic+0x24) [0x1396194]
       mongod(__wt_bt_read+0x437) [0x1306e07]
       mongod(__wt_cache_read+0x1C5) [0x130b2e5]
       mongod(__wt_page_in_func+0x403) [0x1308683]
       mongod(__wt_tree_walk+0x594) [0x131b9f4]
       mongod(__wt_btcur_next+0x2D7) [0x12f2d27]
       mongod(+0xF37E89) [0x1337e89]
       mongod(_ZN5mongo21WiredTigerRecordStore27cappedDeleteAsNeeded_inlockEPNS_16OperationContextERKNS_8RecordIdE+0x18F) [0xd815df]
       mongod(+0x987139) [0xd87139]
       mongod(_ZN5mongo13BackgroundJob7jobBodyEv+0x120) [0xef1010]
       mongod(+0xBB65B4) [0xfb65b4]
       libpthread.so.0(+0x7DF3) [0x7ff6d2debdf3]
       libc.so.6(clone+0x6D) [0x7ff6d189a1ad]
      -----  END BACKTRACE  -----
      2015-04-08T13:10:42.472+0000 I -        [WiredTigerRecordStoreThread for local.oplog.rs] 
      
      ***aborting after fassert() failure
      

            Assignee:
            Unassigned Unassigned
            Reporter:
            klall Kam Lall
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated:
              Resolved: