[SERVER-17142] corruption in sizeStorer.wt file after kill -9 on server Created: 31/Jan/15  Updated: 06/Mar/15  Resolved: 04/Feb/15

Status: Closed
Project: Core Server
Component/s: WiredTiger
Affects Version/s: 3.0.0-rc7
Fix Version/s: 3.0.0-rc8

Type: Bug Priority: Major - P3
Reporter: Asya Kamsky Assignee: Bruce Lucas (Inactive)
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File dbpath-1.tgz     File dbpath-2.tgz     File dbpath-3.tgz     File server17142.tgz     File sizeStorer.wt    
Issue Links:
Related
related to SERVER-17086 Can't start MongoDB w/ WiredTiger Eng... Closed
is related to SERVER-17131 log write doesn't happen at the same ... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Participants:

 Description   

After killing mongod with -9 I can't start it - the error is:

2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] db version v3.0.0-rc7
2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] git version: e4c60053b2967e16f765fa25d16aa6d629faa196
2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] build info: Linux build14.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] allocator: tcmalloc
2015-01-31T16:36:47.708-0600 I CONTROL  [initandlisten] options: { storage: { dbPath: "/disk1/db/all", engine: "wiredTiger" } }
2015-01-31T16:36:47.740-0600 W -        [initandlisten] Detected unclean shutdown - /disk1/db/all/mongod.lock is not empty.
2015-01-31T16:36:47.740-0600 W STORAGE  [initandlisten] Recovering data from the last clean checkpoint.
2015-01-31T16:36:47.740-0600 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=63G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
2015-01-31T16:36:47.787-0600 I -        [initandlisten] Assertion: 10334:BSONObj size: 1681461248 (0x64391000) is invalid. Size must be between 0 and 16793600(16MB) First element: �UỘ��V�r
                                                                                                                                                                                            : ?type=84
2015-01-31T16:36:47.795-0600 I CONTROL  [initandlisten]
 0xf3a9d9 0xee4b21 0xec961f 0xec96cc 0x80d22b 0xd66055 0xd5246f 0xd4fd78 0xa6543d 0x7e0237 0x7e5459 0x320d61ed5d 0x7ddf29
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"400000","o":"B3A9D9"},{"b":"400000","o":"AE4B21"},{"b":"400000","o":"AC961F"},{"b":"400000","o":"AC96CC"},{"b":"400000","o":"40D22B"},{"b":"400000","o":"966055"},{"b":"400000","o":"95246F"},{"b":"400000","o":"94FD78"},{"b":"400000","o":"66543D"},{"b":"400000","o":"3E0237"},{"b":"400000","o":"3E5459"},{"b":"320D600000","o":"1ED5D"},{"b":"400000","o":"3DDF29"}],"processInfo":{ "mongodbVersion" : "3.0.0-rc7", "gitVersion" : "e4c60053b2967e16f765fa25d16aa6d629faa196", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.1.3.el6.x86_64", "version" : "#1 SMP Tue Nov 11 17:57:25 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB70FF000", "elfType" : 3 }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F884AD42000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf3a9d9]
 mongod(_ZN5mongo10logContextEPKc+0xE1) [0xee4b21]
 mongod(_ZN5mongo11msgassertedEiPKc+0xAF) [0xec961f]
 mongod(+0xAC96CC) [0xec96cc]
 mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x38B) [0x80d22b]
 mongod(_ZN5mongo20WiredTigerSizeStorer8loadFromEPNS_17WiredTigerSessionERKSs+0x515) [0xd66055]
 mongod(_ZN5mongo18WiredTigerKVEngineC1ERKSsS2_bb+0x53F) [0xd5246f]
 mongod(+0x94FD78) [0xd4fd78]
 mongod(_ZN5mongo23GlobalEnvironmentMongoD22setGlobalStorageEngineERKSs+0x30D) [0xa6543d]
 mongod(_ZN5mongo13initAndListenEi+0x6F7) [0x7e0237]
 mongod(main+0x139) [0x7e5459]
 libc.so.6(__libc_start_main+0xFD) [0x320d61ed5d]
 mongod(+0x3DDF29) [0x7ddf29]
-----  END BACKTRACE  -----
2015-01-31T16:36:47.795-0600 I STORAGE  [initandlisten] exception in initAndListen: 10334 BSONObj size: 1681461248 (0x64391000) is invalid. Size must be between 0 and 16793600(16MB) First element: �UỘ��V�r
       : ?type=84, terminating
2015-01-31T16:36:47.795-0600 I CONTROL  [initandlisten] dbexit:  rc: 100



 Comments   
Comment by Daniel Pasette (Inactive) [ 31/Jan/15 ]

can you attach the sizeStorer.wt file to this ticket?

Generated at Thu Feb 08 03:43:26 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.