Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-17142

corruption in sizeStorer.wt file after kill -9 on server

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-rc7
    • Fix Version/s: 3.0.0-rc8
    • Component/s: WiredTiger
    • Labels:
      None
    • Backwards Compatibility:
      Fully Compatible
    • Operating System:
      ALL

      Description

      After killing mongod with -9 I can't start it - the error is:

      2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] db version v3.0.0-rc7
      2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] git version: e4c60053b2967e16f765fa25d16aa6d629faa196
      2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] build info: Linux build14.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
      2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] allocator: tcmalloc
      2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] options: { storage: { dbPath: "/disk1/db/all", engine: "wiredTiger" } }
      2015-01-31T16:36:47.740-0600 W -        [initandlisten] Detected unclean shutdown - /disk1/db/all/mongod.lock is not empty.
      2015-01-31T16:36:47.740-0600 W STORAGE  [initandlisten] Recovering data from the last clean checkpoint.
      2015-01-31T16:36:47.740-0600 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=63G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2015-01-31T16:36:47.787-0600 I -        [initandlisten] Assertion: 10334:BSONObj size: 1681461248 (0x64391000) is invalid. Size must be between 0 and 16793600(16MB) First element: �UỘ��V�r
                                                                                                                                                                                                  : ?type=84
      2015-01-31T16:36:47.795-0600 I CONTROL  [initandlisten]
       0xf3a9d9 0xee4b21 0xec961f 0xec96cc 0x80d22b 0xd66055 0xd5246f 0xd4fd78 0xa6543d 0x7e0237 0x7e5459 0x320d61ed5d 0x7ddf29
      ----- BEGIN BACKTRACE -----
      {"backtrace":[{"b":"400000","o":"B3A9D9"},{"b":"400000","o":"AE4B21"},{"b":"400000","o":"AC961F"},{"b":"400000","o":"AC96CC"},{"b":"400000","o":"40D22B"},{"b":"400000","o":"966055"},{"b":"400000","o":"95246F"},{"b":"400000","o":"94FD78"},{"b":"400000","o":"66543D"},{"b":"400000","o":"3E0237"},{"b":"400000","o":"3E5459"},{"b":"320D600000","o":"1ED5D"},{"b":"400000","o":"3DDF29"}],"processInfo":{ "mongodbVersion" : "3.0.0-rc7", "gitVersion" : "e4c60053b2967e16f765fa25d16aa6d629faa196", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.1.3.el6.x86_64", "version" : "#1 SMP Tue Nov 11 17:57:25 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB70FF000", "elfType" : 3 }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F884AD42000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }}
       mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf3a9d9]
       mongod(_ZN5mongo10logContextEPKc+0xE1) [0xee4b21]
       mongod(_ZN5mongo11msgassertedEiPKc+0xAF) [0xec961f]
       mongod(+0xAC96CC) [0xec96cc]
       mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x38B) [0x80d22b]
       mongod(_ZN5mongo20WiredTigerSizeStorer8loadFromEPNS_17WiredTigerSessionERKSs+0x515) [0xd66055]
       mongod(_ZN5mongo18WiredTigerKVEngineC1ERKSsS2_bb+0x53F) [0xd5246f]
       mongod(+0x94FD78) [0xd4fd78]
       mongod(_ZN5mongo23GlobalEnvironmentMongoD22setGlobalStorageEngineERKSs+0x30D) [0xa6543d]
       mongod(_ZN5mongo13initAndListenEi+0x6F7) [0x7e0237]
       mongod(main+0x139) [0x7e5459]
       libc.so.6(__libc_start_main+0xFD) [0x320d61ed5d]
       mongod(+0x3DDF29) [0x7ddf29]
      -----  END BACKTRACE  -----
      2015-01-31T16:36:47.795-0600 I STORAGE  [initandlisten] exception in initAndListen: 10334 BSONObj size: 1681461248 (0x64391000) is invalid. Size must be between 0 and 16793600(16MB) First element: �UỘ��V�r
             : ?type=84, terminating
      2015-01-31T16:36:47.795-0600 I CONTROL  [initandlisten] dbexit:  rc: 100

      1. dbpath-1.tgz
        325 kB
        Asya Kamsky
      2. dbpath-2.tgz
        327 kB
        Asya Kamsky
      3. dbpath-3.tgz
        98 kB
        Asya Kamsky
      4. server17142.tgz
        104 kB
        Asya Kamsky
      5. sizeStorer.wt
        44 kB
        Asya Kamsky

        Issue Links

          Activity

          • Comments
          Hide
          pasette Dan Pasette added a comment -

          can you attach the sizeStorer.wt file to this ticket?

          Show
          pasette Dan Pasette added a comment - can you attach the sizeStorer.wt file to this ticket?

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: