[SERVER-6896] Server crashes if logRotate is issued and the file cannot be rotated Created: 30/Aug/12  Updated: 15/Feb/13  Resolved: 06/Dec/12

Status: Closed
Project: Core Server
Component/s: Stability
Affects Version/s: 2.2.0
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Sridhar Nanjundeswaran Assignee: Tad Marshall
Resolution: Done Votes: 1
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

mongodb v2.2 2008+ build on Windows 7 x64


Issue Links:
Depends
Related
related to SERVER-7869 Display error code when logRotate is ... Closed
is related to SERVER-7707 MongoDB 2.2.1/Linux, 32-bit crashing ... Closed
Operating System: ALL
Participants:

 Description   

Start db with logpath.
mongod.exe --dbpath c:\data\db --logpath c:\data\mongod.log -vvvvv

From a command prompt do more c:\data\mongod.log

Now connect using the mongo shell and do db.adminCommand("logRotate"). This causes the server to die with the following in the logs

Wed Aug 29 20:38:26 [conn1] runQuery called admin.$cmd { logRotate: 1.0 }
Wed Aug 29 20:38:26 [conn1] run command admin.$cmd { logRotate: 1.0 }
Wed Aug 29 20:38:26 [conn1] command: { logRotate: 1.0 }
Wed Aug 29 20:38:26 [conn1] ERROR: Failed to rename c:\data\mongod.log to c:\data\mongod.log.2012-08-30T03-38-26  Fatal Assertion 16175
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\util\stacktrace.cpp(161)                           mongo::printStackTrace+0x3e
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\util\assert_util.cpp(126)                          mongo::fassertFailed+0x43
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\db\dbcommands_generic.cpp(347)                     mongo::LogRotateCmd::run+0x17
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\db\dbcommands.cpp(1859)                            mongo::_execCommand+0x69
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\db\dbcommands.cpp(1986)                            mongo::execCommand+0x983
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\db\dbcommands.cpp(2079)                            mongo::_runCommands+0x3d7
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\db\ops\query.cpp(43)                               mongo::runCommands+0x46
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\db\ops\query.cpp(919)                              mongo::runQuery+0x414
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\db\instance.cpp(244)                               mongo::receivedQuery+0x16d
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\db\instance.cpp(390)                               mongo::assembleResponse+0x2ed
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\db\db.cpp(192)                                     mongo::MyMessageHandler::process+0xf5
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\mongo\util\net\message_server_port.cpp(86)               mongo::pms::threadRun+0x59a
Wed Aug 29 20:38:26 [conn1] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(180)  boost::`anonymous namespace'::thread_start_function+0x21
Wed Aug 29 20:38:26 [conn1] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)      _callthreadstartex+0x17
Wed Aug 29 20:38:26 [conn1] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)      _threadstartex+0x7f
Wed Aug 29 20:38:26 [conn1] kernel32.dll                                                                   BaseThreadInitThunk+0xd
Wed Aug 29 20:38:26 [conn1] 
 
***aborting after fassert() failure



 Comments   
Comment by Tad Mannes [ 10/Dec/12 ]

Hello Dan, the permissions on /home/bgtxatl/data_store/logs is:
drwxr-xr-x 2 bgtxatl badger 4096 Dec 10 00:05 /home/bgtxatl/data_store/logs/
The mongod instance is running as the "bgtxatl" user.

Comment by Daniel Pasette (Inactive) [ 08/Dec/12 ]

Can you send the permissions on /home/bgtxatl/data_store/logs/?

Comment by Tad Mannes [ 07/Dec/12 ]

I neglected to mention that we run on RedHat EL 6 in production, and we built our own mongo executables, libraries, from source. The source we used was actually version 2.2.1 so this issue is clearly not resolved.
Here is the head of our mongod log file:
Tue Dec 4 16:54:17 [initandlisten] MongoDB starting : pid=3948 port=27017 dbpath=/home/bgtxatl/data_store/database 64-bit host=bgtx4atl
Tue Dec 4 16:54:17 [initandlisten]
Tue Dec 4 16:54:17 [initandlisten] ** WARNING: /proc/sys/vm/zone_reclaim_mode is 1
Tue Dec 4 16:54:17 [initandlisten] ** We suggest setting it to 0
Tue Dec 4 16:54:17 [initandlisten] ** http://www.kernel.org/doc/Documentation/sysctl/vm.txt
Tue Dec 4 16:54:17 [initandlisten] db version v2.2.1, pdfile version 4.5
Tue Dec 4 16:54:17 [initandlisten] git version: nogitversion
Tue Dec 4 16:54:17 [initandlisten] build info: Linux walnut 2.6.32-131.0.15.el6.x86_64 #1 SMP Tue May 10 15:42:40 EDT 2011 x86_64 BOOST_LIB_VERSION=1_49
Tue Dec 4 16:54:17 [initandlisten] options:

{ bind_ip: "host2", cpu: true, dbpath: "/home/bgtxatl/data_store/database", fork: true, logappend: true, logpath: "/home/bgtxatl/data_store/logs/mongod.log", port: 27017, quiet: true, replSet: "bgtxatl", rest: true }

Tue Dec 4 16:54:17 [initandlisten] journal dir=/home/bgtxatl/data_store/database/journal
Tue Dec 4 16:54:17 [initandlisten] recover : no journal files present, no recovery needed
Tue Dec 4 16:54:17 [initandlisten] waiting for connections on port 27017
Tue Dec 4 16:54:17 [websvr] admin web console waiting for connections on port 28017
Tue Dec 4 16:54:19 [rsStart] replSet I am host2:27017
Tue Dec 4 16:54:19 [rsHealthPoll] replSet member host1:27017 is up
Tue Dec 4 16:54:19 [rsHealthPoll] replSet member host1:27017 is now in state SECONDARY
Tue Dec 4 16:54:19 [rsStart] replSet STARTUP2
Tue Dec 4 16:54:19 [rsHealthPoll] replSet member host3:27017 is up
Tue Dec 4 16:54:19 [rsHealthPoll] replSet member host3:27017 is now in state PRIMARY
Tue Dec 4 16:54:20 [rsSync] replSet SECONDARY
Tue Dec 4 16:54:21 [rsHealthPoll] replSet member host4:27017 is up
Tue Dec 4 16:54:21 [rsHealthPoll] replSet member host4:27017 is now in state SECONDARY
Tue Dec 4 16:54:21 [rsHealthPoll] replSet member host5:27017 is up
Tue Dec 4 16:54:21 [rsHealthPoll] replSet member host5:27017 is now in state ARBITER
Tue Dec 4 16:54:21 [snapshotthread] cpu: elapsed:4000 writelock: 0%
Tue Dec 4 16:54:25 [rsBackgroundSync] replSet syncing to: host1:27017
Tue Dec 4 16:54:25 [rsSyncNotifier] replset setting oplog notifier to host1:27017
Tue Dec 4 16:54:25 [snapshotthread] cpu: elapsed:4000 writelock: 0%
Tue Dec 4 16:54:29 [snapshotthread] cpu: elapsed:4000 writelock: 0%
Tue Dec 4 16:54:33 [snapshotthread] cpu: elapsed:4000 writelock: 0%

Comment by Tad Mannes [ 07/Dec/12 ]

We also get this issue. What is interesting is that we can issue the logRotate command by hand and it generally works, but when we put it in a bash script and it runs near midnight GMT, we frequently see this issue. At present there is very little to no usage of the database at so I don't believe the issue is related to it being in use. Our bash script basically does this:

echo "db.runCommand(

{logRotate:1}

);" | $MONGODIR/bin/mongo $BADGER_DATASTORE_SERVER/admin 2>&1

Here is the very end of our mongod log file:
Fri Dec 7 00:04:47 [snapshotthread] cpu: elapsed:4000 writelock: 0%
Fri Dec 7 00:04:51 [snapshotthread] cpu: elapsed:4000 writelock: 0%
Fri Dec 7 00:04:55 [snapshotthread] cpu: elapsed:4000 writelock: 0%
Fri Dec 7 00:04:59 [snapshotthread] cpu: elapsed:4000 writelock: 0%
Fri Dec 7 00:05:02 [conn29756] ERROR: Failed to rename /home/bgtxatl/data_store/logs/mongod.log to /home/bgtxatl/data_store/logs/mongod.log.2012-12-07T00-05-02 Fatal Assertion 16175
0x9aa076 0x977203 0x6bee31 0x6a00fc 0x6a20db 0x6a2dd0 0x797bfa 0x79d65a 0x738865 0x73d750 0x5900c9 0x999f89 0x33170077f1 0x33032e570d
/usr/local/mongo/bin/mongod(_ZN5mongo15printStackTraceERSo+0x26) [0x9aa076]
/usr/local/mongo/bin/mongod(_ZN5mongo13fassertFailedEi+0x63) [0x977203]
/usr/local/mongo/bin/mongod() [0x6bee31]
/usr/local/mongo/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRNS_14BSONObjBuilderEb+0x4c) [0x6a00fc]
/usr/local/mongo/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x7bb) [0x6a20db]
/usr/local/mongo/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x310) [0x6a2dd0]
/usr/local/mongo/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x3a) [0x797bfa]
/usr/local/mongo/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x87a) [0x79d65a]
/usr/local/mongo/bin/mongod() [0x738865]
/usr/local/mongo/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x460) [0x73d750]
/usr/local/mongo/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xd9) [0x5900c9]
/usr/local/mongo/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x459) [0x999f89]
/lib64/libpthread.so.0() [0x33170077f1]
/lib64/libc.so.6(clone+0x6d) [0x33032e570d]
Fri Dec 7 00:05:02 [conn29756]

***aborting after fassert() failure

Fri Dec 7 00:05:02 Got signal: 6 (Aborted).

Fri Dec 7 00:05:02 Backtrace:
0x9aa076 0x578bbd 0x3303232900 0x3303232885 0x3303234065 0x97723e 0x6bee31 0x6a00fc 0x6a20db 0x6a2dd0 0x797bfa 0x79d65a 0x738865 0x73d750 0x5900c9 0x999f89 0x33170077f1 0x33032e570d
/usr/local/mongo/bin/mongod(_ZN5mongo15printStackTraceERSo+0x26) [0x9aa076]
/usr/local/mongo/bin/mongod(_ZN5mongo10abruptQuitEi+0x39d) [0x578bbd]
/lib64/libc.so.6() [0x3303232900]
/lib64/libc.so.6(gsignal+0x35) [0x3303232885]
/lib64/libc.so.6(abort+0x175) [0x3303234065]
/usr/local/mongo/bin/mongod(_ZN5mongo13fassertFailedEi+0x9e) [0x97723e]
/usr/local/mongo/bin/mongod() [0x6bee31]
/usr/local/mongo/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRNS_14BSONObjBuilderEb+0x4c) [0x6a00fc]
/usr/local/mongo/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x7bb) [0x6a20db]
/usr/local/mongo/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x310) [0x6a2dd0]
/usr/local/mongo/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x3a) [0x797bfa]
/usr/local/mongo/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x87a) [0x79d65a]
/usr/local/mongo/bin/mongod() [0x738865]
/usr/local/mongo/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x460) [0x73d750]
/usr/local/mongo/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xd9) [0x5900c9]
/usr/local/mongo/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x459) [0x999f89]
/lib64/libpthread.so.0() [0x33170077f1]
/lib64/libc.so.6(clone+0x6d) [0x33032e570d]

We do log rotation every night, and this is becoming a serious issue for us.

Comment by Ian Whalen (Inactive) [ 06/Dec/12 ]

this should indeed fassert() as it does

Comment by Tad Marshall [ 04/Dec/12 ]

Fatal Assertions 16175 and 16176 are both for a failure of the 'rotateLogs()' function, but come from two different places in the code.

16175 is for a failure of the 'logRotate' command (e.g. 'db.adminCommand("logRotate")').

16176 is for a failure when SIGUSR1 has been received (not available on Windows).

The triggering failure (for this case) of the rename operation is the same for both Fatal Assertions.

Comment by Kristian Brimble [ 04/Dec/12 ]

Same failure conditions on 12:04 but looks like it was a different assertion.

Tue Dec  4 01:00:02 [conn632571] ERROR: Failed to rename /var/log/mongodb/mongodb.log to /var/log/mongodb/mongodb.log.2012-12-04T01-00-02  Fatal Assertion 16175
Tue Dec  4 01:00:02 [conn632572] end connection 127.0.0.1:48397 (6 connections now open)
0xade6e1 0x802e03 0x6416c1 0x6571f1 0x658d5d 0x659c1e 0x6afa08 0x6b3241 0xb5ba7d 0xb5d052 0x56fa52 0x5dbf11 0x7feca7875e9a 0x7feca6b8b4bd
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xade6e1]
 /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0x802e03]
 /usr/bin/mongod() [0x6416c1]
 /usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRNS_14BSONObjBuilderEb+0x51) [0x6571f1]
 /usr/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xcfd) [0x658d5d]
 /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x2ae) [0x659c1e]
 /usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x38) [0x6afa08]
 /usr/bin/mongod(_ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1_+0xbc1) [0x6b3241]
 /usr/bin/mongod() [0xb5ba7d]
 /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x3a2) [0xb5d052]
 /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x82) [0x56fa52]
 /usr/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x411) [0x5dbf11]
 /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7feca7875e9a]
 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7feca6b8b4bd]
Tue Dec  4 01:00:02 [conn632571]
 
***aborting after fassert() failure
 
 
Tue Dec  4 01:00:02 Got signal: 6 (Aborted).
 
Tue Dec  4 01:00:02 Backtrace:
0xade6e1 0x5582d9 0x7feca6acf4c0 0x7feca6acf445 0x7feca6ad2bab 0x802e3e 0x6416c1 0x6571f1 0x658d5d 0x659c1e 0x6afa08 0x6b3241 0xb5ba7d 0xb5d052 0x56fa52 0x5dbf11 0x7feca7875e9a 0x7feca6b8b4bd
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xade6e1]
 /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x5582d9]
 /lib/x86_64-linux-gnu/libc.so.6(+0x364c0) [0x7feca6acf4c0]
 /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7feca6acf445]
 /lib/x86_64-linux-gnu/libc.so.6(abort+0x17b) [0x7feca6ad2bab]
 /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xde) [0x802e3e]
 /usr/bin/mongod() [0x6416c1]
 /usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRNS_14BSONObjBuilderEb+0x51) [0x6571f1]
 /usr/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xcfd) [0x658d5d]
 /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x2ae) [0x659c1e]
 /usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x38) [0x6afa08]
 /usr/bin/mongod(_ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1_+0xbc1) [0x6b3241]
 /usr/bin/mongod() [0xb5ba7d]
 /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x3a2) [0xb5d052]
 /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x82) [0x56fa52]
 /usr/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x411) [0x5dbf11]
 /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7feca7875e9a]
 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7feca6b8b4bd]
 
 
 
***** SERVER RESTARTED *****

This has only happened once.

Comment by Tony Nelson [ 24/Sep/12 ]

I am having the same problem on Ubuntu 10.04 (lucid). This server is actually unused at the moment, but every Sunday when logrotate executes, the server crashes. Here is log for the last week:

mongodb.log.1

tnelson@bender:/var/log/mongodb$ cat mongodb.log.1
Sun Sep 16 08:07:26 [initandlisten] MongoDB starting : pid=14222 port=27017 dbpath=/var/lib/mongodb 64-bit host=bender
Sun Sep 16 08:07:26 [initandlisten] db version v2.2.0, pdfile version 4.5
Sun Sep 16 08:07:26 [initandlisten] git version: f5e83eae9cfbec7fb7a071321928f00d1b0c5207
Sun Sep 16 08:07:26 [initandlisten] build info: Linux ip-10-2-29-40 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_49
Sun Sep 16 08:07:26 [initandlisten] options: { config: "/etc/mongodb.conf", dbpath: "/var/lib/mongodb", logappend: "true", logpath: "/var/log/mongodb/mongodb.log", rest: "true" }
Sun Sep 16 08:07:26 [initandlisten] journal dir=/var/lib/mongodb/journal
Sun Sep 16 08:07:26 [initandlisten] recover begin
Sun Sep 16 08:07:26 [initandlisten] info no lsn file in journal/ directory
Sun Sep 16 08:07:26 [initandlisten] recover lsn: 0
Sun Sep 16 08:07:26 [initandlisten] recover /var/lib/mongodb/journal/j._0
Sun Sep 16 08:07:26 [initandlisten] recover cleaning up
Sun Sep 16 08:07:26 [initandlisten] removeJournalFiles
Sun Sep 16 08:07:28 [initandlisten] recover done
Sun Sep 16 08:07:28 [initandlisten] preallocating a journal file /var/lib/mongodb/journal/prealloc.0
Sun Sep 16 08:07:31 [initandlisten] 		398458880/1073741824	37%
Sun Sep 16 08:07:34 [initandlisten] 		545259520/1073741824	50%
Sun Sep 16 08:07:37 [initandlisten] 		692060160/1073741824	64%
Sun Sep 16 08:07:40 [initandlisten] 		828375040/1073741824	77%
Sun Sep 16 08:07:43 [initandlisten] 		985661440/1073741824	91%
Sun Sep 16 08:07:50 [initandlisten] waiting for connections on port 27017
Sun Sep 16 08:07:50 [websvr] admin web console waiting for connections on port 28017
Sun Sep 23 06:27:51 [initandlisten] ERROR: Failed to rename /var/log/mongodb/mongodb.log to /var/log/mongodb/mongodb.log.2012-09-23T10-27-51  Fatal Assertion 16176
0xade6e1 0x802e03 0x5c8dcc 0x7fd61f5aeaf0 0x7fd61f65a5a3 0x6a4a5a 0x559154 0x55c86a 0x55d2dd 0x563dbe 0x565399 0x7fd61f599c4d 0x557869 
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xade6e1]
 /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0x802e03]
 /usr/bin/mongod() [0x5c8dcc]
 /lib/libc.so.6(+0x33af0) [0x7fd61f5aeaf0]
 /lib/libc.so.6(__select+0x33) [0x7fd61f65a5a3]
 /usr/bin/mongod(_ZN5mongo8Listener13initAndListenEv+0x30a) [0x6a4a5a]
 /usr/bin/mongod(_ZN5mongo6listenEi+0x1b4) [0x559154]
 /usr/bin/mongod(_ZN5mongo14_initAndListenEi+0x5fa) [0x55c86a]
 /usr/bin/mongod(_ZN5mongo13initAndListenEi+0x1d) [0x55d2dd]
 /usr/bin/mongod() [0x563dbe]
 /usr/bin/mongod(main+0x9) [0x565399]
 /lib/libc.so.6(__libc_start_main+0xfd) [0x7fd61f599c4d]
 /usr/bin/mongod(__gxx_personality_v0+0x469) [0x557869]
Sun Sep 23 06:27:51 [initandlisten] 
 
***aborting after fassert() failure
 
 
Sun Sep 23 06:27:51 Got signal: 6 (Aborted).
 
Sun Sep 23 06:27:51 Backtrace:
0xade6e1 0x5582d9 0x7fd61f5aeaf0 0x7fd61f5aea75 0x7fd61f5b25c0 0x802e3e 0x5c8dcc 0x7fd61f5aeaf0 0x7fd61f65a5a3 0x6a4a5a 0x559154 0x55c86a 0x55d2dd 0x563dbe 0x565399 0x7fd61f599c4d 0x557869 
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xade6e1]
 /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x5582d9]
 /lib/libc.so.6(+0x33af0) [0x7fd61f5aeaf0]
 /lib/libc.so.6(gsignal+0x35) [0x7fd61f5aea75]
 /lib/libc.so.6(abort+0x180) [0x7fd61f5b25c0]
 /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xde) [0x802e3e]
 /usr/bin/mongod() [0x5c8dcc]
 /lib/libc.so.6(+0x33af0) [0x7fd61f5aeaf0]
 /lib/libc.so.6(__select+0x33) [0x7fd61f65a5a3]
 /usr/bin/mongod(_ZN5mongo8Listener13initAndListenEv+0x30a) [0x6a4a5a]
 /usr/bin/mongod(_ZN5mongo6listenEi+0x1b4) [0x559154]
 /usr/bin/mongod(_ZN5mongo14_initAndListenEi+0x5fa) [0x55c86a]
 /usr/bin/mongod(_ZN5mongo13initAndListenEi+0x1d) [0x55d2dd]
 /usr/bin/mongod() [0x563dbe]
 /usr/bin/mongod(main+0x9) [0x565399]
 /lib/libc.so.6(__libc_start_main+0xfd) [0x7fd61f599c4d]
 /usr/bin/mongod(__gxx_personality_v0+0x469) [0x557869]
 
tnelson@bender:/var/log/mongodb$ 
 

Comment by Sridhar Nanjundeswaran [ 30/Aug/12 ]

Definitely not a fatal assert. In fact we seem to be handling it on startup. So have a large mongod.log file on which you do a more. Now start mongod with logpath pointing to this file. In this scenario we just log to console and start up. I see this at the beginning of the console log
all output going to: c:\data\mongod.log
log file [c:\data\mongod.log] exists and couldn't make backup; run with --logapp
end or manually remove file (Permission denied)

Comment by Tad Marshall [ 30/Aug/12 ]

Also, the error reporting doesn't report the OS error number and string, and is missing an endl so the Fatal Assertion text is on the same line.

I don't think this should be a fatal assertion, since it does not indicate corrupted state.

Generated at Thu Feb 08 03:13:02 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.