***** SERVER RESTARTED ***** Mon Jul 22 17:02:50.008 [initandlisten] MongoDB starting : pid=21046 port=10000 dbpath=/mongodb/scheme2/sh0/data 64-bit host=loc alhost.localdomain Mon Jul 22 17:02:50.009 [initandlisten] db version v2.4.4 Mon Jul 22 17:02:50.009 [initandlisten] git version: 4ec1fb96702c9d4c57b1e06dd34eb73a16e407d2 Mon Jul 22 17:02:50.009 [initandlisten] build info: Linux ip-10-2-29-40 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 ES T 2009 x86_64 BOOST_LIB_VERSION=1_49 Mon Jul 22 17:02:50.009 [initandlisten] allocator: tcmalloc Mon Jul 22 17:02:50.009 [initandlisten] options: { dbpath: "/mongodb/scheme2/sh0/data", fork: true, logappend: true, logpath: "/ mongodb/scheme2/sh0/logs/sh0.log", port: 10000, replSet: "sh0" } Mon Jul 22 17:02:50.028 [initandlisten] journal dir=/mongodb/scheme2/sh0/data/journal Mon Jul 22 17:02:50.028 [initandlisten] recover begin Mon Jul 22 17:02:50.028 [initandlisten] recover lsn: 165824241 Mon Jul 22 17:02:50.028 [initandlisten] recover /mongodb/scheme2/sh0/data/journal/j._3 Mon Jul 22 17:02:50.028 [initandlisten] recover skipping application of section seq:163744599 < lsn:165824241 Mon Jul 22 17:02:50.029 [initandlisten] recover skipping application of section seq:163803982 < lsn:165824241 Mon Jul 22 17:02:50.031 [initandlisten] recover skipping application of section seq:163863362 < lsn:165824241 Mon Jul 22 17:02:50.033 [initandlisten] recover skipping application of section seq:163922760 < lsn:165824241 Mon Jul 22 17:02:50.035 [initandlisten] recover skipping application of section seq:163982152 < lsn:165824241 Mon Jul 22 17:02:50.037 [initandlisten] recover skipping application of section seq:164041542 < lsn:165824241 Mon Jul 22 17:02:50.039 [initandlisten] recover error: abrupt end to file /mongodb/scheme2/sh0/data/journal/j._3, yet it isn't t he last journal file Mon Jul 22 17:02:50.039 [initandlisten] dbexception during recovery: 13535 recover abrupt journal file end Mon Jul 22 17:02:50.039 [initandlisten] exception in initAndListen: 13535 recover abrupt journal file end, terminating Mon Jul 22 17:02:50.039 dbexit: Mon Jul 22 17:02:50.039 [initandlisten] shutdown: going to close listening sockets... Mon Jul 22 17:02:50.039 [initandlisten] shutdown: going to flush diaglog... Mon Jul 22 17:02:50.040 [initandlisten] shutdown: going to close sockets... Mon Jul 22 17:02:50.040 [initandlisten] shutdown: waiting for fs preallocator... "scheme2/sh0/logs/sh0.log" 810L, 82427C Mon Jul 22 17:29:18.460 [initandlisten] connection accepted from 192.168.69.54:43638 #8 (6 connections now open) Mon Jul 22 17:29:25.629 [rsSyncNotifier] replset setting oplog notifier to 192.168.69.54:10000 Mon Jul 22 17:29:25.631 [conn8] command admin.$cmd command: { ismaster: 1 } ntoreturn:1 keyUpdates:0 reslen:298 7170ms Mon Jul 22 17:29:25.639 [repl prefetch worker] getFile(): n=3749684 Mon Jul 22 17:29:25.639 [repl prefetch worker] Assertion: 10295:getFile(): bad file number value (corrupt db?): run repair 0xdd2331 0xd93c6b 0x8cdf45 0xb841e2 0x7f8e05 0x7f8e25 mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd2331] mongod(_ZN5mongo11msgassertedEiPKc+0x9b) [0xd93c6b] mongod(_ZN5mongo8Database7getFileEiib+0x395) [0x8cdf45] mongod(_ZNK5mongo7DiskLoc3recEv+0x42) [0xb841e2] Mon Jul 22 17:29:25.648 [repl writer worker 1] getFile(): n=3749684 Mon Jul 22 17:29:25.648 [repl writer worker 1] Assertion: 10295:getFile(): bad file number value (corrupt db?): run repair 0xdd2331 0xd93c6b 0x8cdf45 0xb841e2 0x7fe355 0x7fe3af mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd2331] mongod(_ZN5mongo11msgassertedEiPKc+0x9b) [0xd93c6b] mongod(_ZN5mongo8Database7getFileEiib+0x395) [0x8cdf45] mongod(_ZNK5mongo7DiskLoc3recEv+0x42) [0xb841e2] Mon Jul 22 17:29:25.648 [repl writer worker 1] getFile(): n=3749684 Mon Jul 22 17:29:25.648 [repl writer worker 1] Assertion: 10295:getFile(): bad file number value (corrupt db?): run repair 0xdd2331 0xd93c6b 0x8cdf45 0xb841e2 0x7fe355 0x7fe3af mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd2331] mongod(_ZN5mongo11msgassertedEiPKc+0x9b) [0xd93c6b] mongod(_ZN5mongo8Database7getFileEiib+0x395) [0x8cdf45] mongod(_ZNK5mongo7DiskLoc3recEv+0x42) [0xb841e2] Mon Jul 22 17:29:25.654 [repl writer worker 1] Fatal Assertion 16360 0xdd2331 0xd92323 0xc231db 0xd9fe71 0xe1aad9 0x312fa07851 0x312f6e890d mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd2331] mongod(_ZN5mongo13fassertFailedEi+0xa3) [0xd92323] mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x13b) [0xc231db] mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xd9fe71] mongod() [0xe1aad9] /lib64/libpthread.so.0() [0x312fa07851] /lib64/libc.so.6(clone+0x6d) [0x312f6e890d] Mon Jul 22 17:29:25.661 [repl writer worker 1] ***aborting after fassert() failure Mon Jul 22 17:29:25.661 Got signal: 6 (Aborted). Mon Jul 22 17:29:25.670 Backtrace: 0xdd2331 0x6cfb19 0x312f632920 0x312f6328a5 0x312f634085 0xd9235e 0xc231db 0xd9fe71 0xe1aad9 0x312fa07851 0x312f6e890d mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd2331] mongod(_ZN5mongo10abruptQuitEi+0x399) [0x6cfb19] /lib64/libc.so.6() [0x312f632920] /lib64/libc.so.6(gsignal+0x35) [0x312f6328a5] /lib64/libc.so.6(abort+0x175) [0x312f634085] mongod(_ZN5mongo13fassertFailedEi+0xde) [0xd9235e] mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x13b) [0xc231db] mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xd9fe71] mongod() [0xe1aad9] /lib64/libpthread.so.0() [0x312fa07851] /lib64/libc.so.6(clone+0x6d) [0x312f6e890d]