Tue Jan 14 09:40:30.942 [repl writer worker 3] ERROR: writer worker caught exception: E11000 duplicate key error index: competition.competition.$listingid_1  dup key: { : "2kKN9CzZ" } on: { ts: Timestamp 1389688830000|338, h: -3327769536912367897, v: 2, op: "i", ns: "competition.competition", o: { _id: ObjectId('52d4f7fe810b54b66ced39a2'), listingid: "2kKN9CzZ", results: [ { somefields: "foobar", bla": "bla" } ], lastchanged: 1389688830 } }
Tue Jan 14 09:40:30.942 [repl writer worker 3]   Fatal Assertion 16360
0xde05e1 0xda03d3 0xc28f3c 0xdadf21 0xe28e69 0x7f8d283cfe9a 0x7f8d276e23fd
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xde05e1]
 /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0xda03d3]
 /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x12c) [0xc28f3c]
 /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xdadf21]
 /usr/bin/mongod() [0xe28e69]
 /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7f8d283cfe9a]
 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f8d276e23fd]
Tue Jan 14 09:40:30.990 [repl writer worker 3]
 
***aborting after fassert() failure
 
 
Tue Jan 14 09:40:30.994 Got signal: 6 (Aborted).
 
Tue Jan 14 09:40:30.996 Backtrace:
0xde05e1 0x6d0559 0x7f8d276244a0 0x7f8d27624425 0x7f8d27627b8b 0xda040e 0xc28f3c 0xdadf21 0xe28e69 0x7f8d283cfe9a 0x7f8d276e23fd
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xde05e1]
 /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x6d0559]
 /lib/x86_64-linux-gnu/libc.so.6(+0x364a0) [0x7f8d276244a0]
 /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f8d27624425]
 /lib/x86_64-linux-gnu/libc.so.6(abort+0x17b) [0x7f8d27627b8b]
 /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xde) [0xda040e]
 /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x12c) [0xc28f3c]
 /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xdadf21]
 /usr/bin/mongod() [0xe28e69]
 /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7f8d283cfe9a]
 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f8d276e23fd]
 
 
 
***** SERVER RESTARTED *****
 
 
Tue Jan 14 09:43:57.506 [initandlisten] MongoDB starting : pid=17961 port=27017 dbpath=/db/mongodb/ 64-bit host=REMOVED
Tue Jan 14 09:43:57.506 [initandlisten] db version v2.4.8
Tue Jan 14 09:43:57.506 [initandlisten] git version: a350fc38922fbda2cec8d5dd842237b904eafc14
Tue Jan 14 09:43:57.506 [initandlisten] build info: Linux ip-10-2-29-40 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_49
Tue Jan 14 09:43:57.506 [initandlisten] allocator: tcmalloc
Tue Jan 14 09:43:57.506 [initandlisten] options: { bind_ip: "REMOVED", config: "/etc/mongodb.conf", dbpath: "/db/mongodb/", fork: "true", logappend: "true", logpath: "/var/log/mongodb/mongodb.log", nojournal: "true", port: 27017, replSet: "rs0" }
**************
Unclean shutdown detected.
Please visit http://dochub.mongodb.org/core/repair for recovery instructions.
*************
Tue Jan 14 09:43:57.518 [initandlisten] exception in initAndListen: 12596 old lock file, terminating
Tue Jan 14 09:43:57.518 dbexit:
Tue Jan 14 09:43:57.518 [initandlisten] shutdown: going to close listening sockets...
Tue Jan 14 09:43:57.518 [initandlisten] shutdown: going to flush diaglog...
Tue Jan 14 09:43:57.518 [initandlisten] shutdown: going to close sockets...
Tue Jan 14 09:43:57.518 [initandlisten] shutdown: waiting for fs preallocator...
Tue Jan 14 09:43:57.518 [initandlisten] shutdown: closing all files...
Tue Jan 14 09:43:57.518 [initandlisten] closeAllFiles() finished
Tue Jan 14 09:43:57.518 dbexit: really exiting now
 
 
***** SERVER RESTARTED *****