[SERVER-3947] mongod segmentation fault Created: 26/Sep/11  Updated: 30/Mar/12  Resolved: 16/Oct/11

Status: Closed
Project: Core Server
Component/s: Querying, Stability, Storage
Affects Version/s: 2.0.0
Fix Version/s: None

Type: Bug Priority: Blocker - P1
Reporter: Dennis Hoene Assignee: Unassigned
Resolution: Duplicate Votes: 1
Labels: FRVIa
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:
  1. uname -a
    Linux winlager-eval 2.6.18-194.32.1.el5 #1 SMP Wed Jan 5 17:52:25 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
  1. cat /etc/redhat-release
    CentOS release 5.5 (Final)
  1. mongod --version
    db version v2.0.0, pdfile version 4.5
    Mon Sep 26 15:55:37 git version: 695c67dff0ffc361b8568a13366f027caa406222
  1. php -v
    PHP 5.3.5 (cli) (built: Feb 19 2011 13:10:09)

mongo php-driver (pecl) 1.2.5


Operating System: Linux
Participants:

 Description   

I'm getting a strange misbehaviour during heavy doc inputs and transformations with multiple connections.

I'm running a single server instance 2.0.0, no replication/sharding. The problem occured since server update from 1.8 to 2.0 and php-driver update from 1.1.4 to 1.2.5. mongod terminates with the following log output:

Mon Sep 26 14:52:22 Invalid access at address: 0

Mon Sep 26 14:52:22 Got signal: 11 (Segmentation fault).

Mon Sep 26 14:52:22 Backtrace:
0xa83fc9 0xa845a0 0x3a5ba0eb10 0x54d7dc 0x83d551 0x83d756 0x83d8b0 0x95e2e9 0x880494 0x88526a 0xa96a46 0x635dd7 0x3a5ba0673d 0x3a5b2d3f6d
/usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa83fc9]
/usr/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x220) [0xa845a0]
/lib64/libpthread.so.0 [0x3a5ba0eb10]
/usr/bin/mongod(_ZN5mongo24FieldRangeVectorIterator7advanceERKNS_7BSONObjE+0x4c) [0x54d7dc]
/usr/bin/mongod(_ZN5mongo11BtreeCursor29skipOutOfRangeKeysAndCheckEndEv+0x81) [0x83d551]
/usr/bin/mongod(_ZN5mongo11BtreeCursor12skipAndCheckEv+0x26) [0x83d756]
/usr/bin/mongod(_ZN5mongo11BtreeCursor7advanceEv+0x100) [0x83d8b0]
/usr/bin/mongod(_ZN5mongo14processGetMoreEPKcixRNS_5CurOpEiRb+0x419) [0x95e2e9]
/usr/bin/mongod(_ZN5mongo15receivedGetMoreERNS_10DbResponseERNS_7MessageERNS_5CurOpE+0x1b4) [0x880494]
/usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xf6a) [0x88526a]
/usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x76) [0xa96a46]
/usr/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x287) [0x635dd7]
/lib64/libpthread.so.0 [0x3a5ba0673d]
/lib64/libc.so.6(clone+0x6d) [0x3a5b2d3f6d]

Logstream::get called in uninitialized state
Mon Sep 26 14:52:22 ERROR: Client::~Client _context should be null but is not; client:conn
Logstream::get called in uninitialized state
Mon Sep 26 14:52:22 ERROR: Client::shutdown not called: conn



 Comments   
Comment by Eliot Horowitz (Inactive) [ 16/Oct/11 ]

See SERVER-3961

Comment by kafka0102 [ 15/Oct/11 ]

I have the same errors and make me roll back to 1.8. I just run 2.0 some time and it crashed. It seems not do special commands.Bellow is the relative logs.Hope it can help.

Tue Oct 11 16:42:02 Got signal: 6 (Aborted).

Tue Oct 11 16:42:02 Backtrace:
0xa83fc9 0x32410302d0 0x3241030265 0x3241031d10 0x324106a84b 0x32410722ef 0x3241074542 0x32410751a2 0x5039e2 0x509eee 0x5091d2 0x509e52 0x88f58c 0x887fad 0x509fba 0x884c51 0xa96a46 0x635dd7 0x3241c064a7 0x32410d3c2d
bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa83fc9]
/lib64/libc.so.6 [0x32410302d0]
/lib64/libc.so.6(gsignal+0x35) [0x3241030265]
/lib64/libc.so.6(abort+0x110) [0x3241031d10]
/lib64/libc.so.6 [0x324106a84b]
/lib64/libc.so.6 [0x32410722ef]
/lib64/libc.so.6 [0x3241074542]
/lib64/libc.so.6(realloc+0x102) [0x32410751a2]
bin/mongod(_ZN5mongo11_BufBuilderINS_16TrivialAllocatorEE15grow_reallocateEv+0x42) [0x5039e2]
bin/mongod(_ZNK5mongo7BSONObj8toStringERNS_13StringBuilderEbb+0x26e) [0x509eee]
bin/mongod(_ZNK5mongo11BSONElement8toStringERNS_13StringBuilderEbb+0x11b2) [0x5091d2]
bin/mongod(_ZNK5mongo7BSONObj8toStringERNS_13StringBuilderEbb+0x1d2) [0x509e52]
bin/mongod(_ZNK5mongo7OpDebug8toStringEv+0x1fc) [0x88f58c]
bin/mongod(_ZNK5mongo14LazyStringImplINS_7OpDebugEE3valEv+0xd) [0x887fad]
bin/mongod(_ZN5mongo9LogstreamlsERKNS_10LazyStringE+0x1a) [0x509fba]
bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x951) [0x884c51]
bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x76) [0xa96a46]
bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x287) [0x635dd7]
/lib64/libpthread.so.0 [0x3241c064a7]
/lib64/libc.so.6(clone+0x6d) [0x32410d3c2d]

Tue Oct 11 16:42:02 Invalid access at address: 0x4

Tue Oct 11 16:42:02 Got signal: 11 (Segmentation fault).

Tue Oct 11 16:42:02 Backtrace:
0xa83fc9 0xa845a0 0x3241c0e7c0 0x54f7c9 0x55b0e4 0x55bdd4 0x8d54a6 0x8d60ba 0x94360d 0x948375 0x8823bc 0x885405 0xa96a46 0x635dd7 0x3241c064a7 0x32410d3c2d
bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa83fc9]
bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x220) [0xa845a0]
/lib64/libpthread.so.0 [0x3241c0e7c0]
bin/mongod(_ZN5mongo10FieldRangeC1ERKNS_11BSONElementEbbb+0x199) [0x54f7c9]
bin/mongod(_ZN5mongo13FieldRangeSet17processQueryFieldERKNS_11BSONElementEb+0x84) [0x55b0e4]
bin/mongod(_ZN5mongo13FieldRangeSetC1EPKcRKNS_7BSONObjEbb+0x194) [0x55bdd4]
bin/mongod(_ZN5mongo16MultiPlanScannerC1EPKcRKNS_7BSONObjES5_PKNS_11BSONElementEbS5_S5_bb+0x1f6) [0x8d54a6]
bin/mongod(_ZN5mongo11MultiCursorC1EPKcRKNS_7BSONObjES5_N5boost10shared_ptrINS0_8CursorOpEEEb+0xda) [0x8d60ba]
bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES2_bbbRNS_7OpDebugEPNS_11RemoveSaverE+0x35d) [0x94360d]
bin/mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES2_bbbRNS_7OpDebugE+0x125) [0x948375]
bin/mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x47c) [0x8823bc]
bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x1105) [0x885405]
bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x76) [0xa96a46]
bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x287) [0x635dd7]
/lib64/libpthread.so.0 [0x3241c064a7]
/lib64/libc.so.6(clone+0x6d) [0x32410d3c2d]

mongod: /opt/extra/include/boost/thread/pthread/mutex.hpp:50: void boost::mutex::lock(): Assertion `!pthread_mutex_lock(&m)' failed.
Tue Oct 11 16:42:23 Got signal: 6 (Aborted).

Tue Oct 11 16:42:23 Backtrace:
0xa83fc9 0x32410302d0 0x3241030265 0x3241031d10 0x32410296e6 0x67cf92 0x67a681 0x67aa94 0xa931cd 0x57756f 0x579624 0xa9ea30 0x3241c064a7 0x32410d3c2d
bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa83fc9]
/lib64/libc.so.6 [0x32410302d0]
/lib64/libc.so.6(gsignal+0x35) [0x3241030265]
/lib64/libc.so.6(abort+0x110) [0x3241031d10]
/lib64/libc.so.6(__assert_fail+0xf6) [0x32410296e6]
bin/mongod(_ZN5boost12shared_mutex11lock_sharedEv+0x182) [0x67cf92]
bin/mongod(_ZN5mongo9MongoFile9_flushAllEb+0x91) [0x67a681]
bin/mongod(_ZN5mongo9MongoFile8flushAllEb+0x14) [0x67aa94]
bin/mongod(_ZN5mongo12DataFileSync3runEv+0x1fd) [0xa931cd]
bin/mongod(_ZN5mongo13BackgroundJob7jobBodyEN5boost10shared_ptrINS0_9JobStatusEEE+0xbf) [0x57756f]
bin/mongod(_ZN5boost6detail11thread_dataINS_3_bi6bind_tIvNS_4_mfi3mf1IvN5mongo13BackgroundJobENS_10shared_ptrINS7_9JobStatusEEEEENS2_5list2INS2_5valueIPS7_EENSD_ISA_EEEEEEE3runEv+0x74) [0x579624]
bin/mongod(thread_proxy+0x80) [0xa9ea30]
/lib64/libpthread.so.0 [0x3241c064a7]
/lib64/libc.so.6(clone+0x6d) [0x32410d3c2d]

Comment by Eliot Horowitz (Inactive) [ 14/Oct/11 ]

@dennis - not sure that's the issue - but we're looking into this

Comment by Dennis Hoene [ 14/Oct/11 ]

Could dropping one or several indexes in a collection and simultaneously sent queries to the corresponding collection lead to such a breakup?

In another case it happened exactly after dropIndexes() and build of a new index (see log). Unfortunately queries aren't being logged.

Fri Oct 14 12:38:33 [conn337] CMD: dropIndexes db1.auftraege
Fri Oct 14 12:38:33 [conn337] build index db1.auftraege

{ auftragsnr: 1 }

background
Fri Oct 14 12:38:33 Invalid access at address: 0

Fri Oct 14 12:38:33 Got signal: 11 (Segmentation fault).

Fri Oct 14 12:38:33 Backtrace:
0xa83fc9 0xa845a0 0x3a5ba0eb10 0x54d7dc 0x83d551 0x83d756 0x83d8b0 0x9bb76f 0x973fe9 0x97512f 0x95d725 0x9607b4 0x87e037 0x88485c 0xa96a46 0x635dd7 0x3a5ba0673d 0x3a5b2d3f6d
/usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa83fc9]
/usr/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x220) [0xa845a0]
/lib64/libpthread.so.0 [0x3a5ba0eb10]
/usr/bin/mongod(_ZN5mongo24FieldRangeVectorIterator7advanceERKNS_7BSONObjE+0x4c) [0x54d7dc]
/usr/bin/mongod(_ZN5mongo11BtreeCursor29skipOutOfRangeKeysAndCheckEndEv+0x81) [0x83d551]
/usr/bin/mongod(_ZN5mongo11BtreeCursor12skipAndCheckEv+0x26) [0x83d756]
/usr/bin/mongod(_ZN5mongo11BtreeCursor7advanceEv+0x100) [0x83d8b0]
/usr/bin/mongod(_ZN5mongo15DistinctCommand3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0xbcf) [0x9bb76f]
/usr/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xb49) [0x973fe9]
/usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x6ff) [0x97512f]
/usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x35) [0x95d725]
/usr/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0xee4) [0x9607b4]
/usr/bin/mongod [0x87e037]
/usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x55c) [0x88485c]
/usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x76) [0xa96a46]
/usr/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x287) [0x635dd7]
/lib64/libpthread.so.0 [0x3a5ba0673d]
/lib64/libc.so.6(clone+0x6d) [0x3a5b2d3f6d]

Logstream::get called in uninitialized state
Fri Oct 14 12:38:33 ERROR: Client::~Client _context should be null but is not; client:conn
Logstream::get called in uninitialized state
Fri Oct 14 12:38:33 ERROR: Client::shutdown not called: conn

Comment by Dennis Hoene [ 12/Oct/11 ]

After further investigation I can track back the segmentation fault: In my case it also occurs during removal/addition of multiple indexes to multiple collections in the background (during queries / live operation).

Comment by Joao Paulo Farias [ 12/Oct/11 ]

Similar issue here, got it while adding an index to a large collection (1.8 million documents) in the background. Log bellow:

Wed Oct 12 11:13:44 [conn9] build index done 1812030 records 105.616 secs
Wed Oct 12 11:13:44 [conn9] insert tsa.system.indexes 105616ms
Wed Oct 12 11:13:45 Invalid access at address: 0

Wed Oct 12 11:13:45 Got signal: 11 (Segmentation fault).

Wed Oct 12 11:13:45 Backtrace:
0xa83fc9 0xa845a0 0x7fdfd7ddec60 0x54d7dc 0x83d551 0x83d756 0x83d8b0 0x95e2e9 0x880494 0x88526a 0xa96a46 0x635dd7 0x7fdfd7dd5d8c 0x7fdfd738004d
/home/anchor/local/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa83fc9]
/home/anchor/local/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x220) [0xa845a0]
/lib/x86_64-linux-gnu/libpthread.so.0(+0xfc60) [0x7fdfd7ddec60]
/home/anchor/local/bin/mongod(_ZN5mongo24FieldRangeVectorIterator7advanceERKNS_7BSONObjE+0x4c) [0x54d7dc]
/home/anchor/local/bin/mongod(_ZN5mongo11BtreeCursor29skipOutOfRangeKeysAndCheckEndEv+0x81) [0x83d551]
/home/anchor/local/bin/mongod(_ZN5mongo11BtreeCursor12skipAndCheckEv+0x26) [0x83d756]
/home/anchor/local/bin/mongod(_ZN5mongo11BtreeCursor7advanceEv+0x100) [0x83d8b0]
/home/anchor/local/bin/mongod(_ZN5mongo14processGetMoreEPKcixRNS_5CurOpEiRb+0x419) [0x95e2e9]
/home/anchor/local/bin/mongod(_ZN5mongo15receivedGetMoreERNS_10DbResponseERNS_7MessageERNS_5CurOpE+0x1b4) [0x880494]
/home/anchor/local/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xf6a) [0x88526a]
/home/anchor/local/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x76) [0xa96a46]
/home/anchor/local/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x287) [0x635dd7]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x6d8c) [0x7fdfd7dd5d8c]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fdfd738004d]

Logstream::get called in uninitialized state
Wed Oct 12 11:13:45 ERROR: Client::~Client _context should be null but is not; client:conn
Logstream::get called in uninitialized stateWed Oct 12 11:13:45 ERROR: Client::shutdown not called: conn

Comment by Harald Lapp [ 11/Oct/11 ]

i have a similar issue. The backtrace is:

Tue Oct 11 09:11:52 [initandlisten] connection accepted from 10.10.0.12:58806 #68483
Tue Oct 11 09:11:53 Invalid access at address: 0x68b9000

Tue Oct 11 09:11:53 Got signal: 11 (Segmentation fault).

Tue Oct 11 09:11:53 [initandlisten] connection accepted from 10.10.0.12:58828 #68484
Tue Oct 11 09:11:53 Backtrace:
0xa83fc9 0xa845a0 0x7fcb5c6828f0 0x7fcb5bbc75e5 0x51d300 0x54cd98 0x54d0ac 0x55a617 0x55b501 0x55bdd4 0x8d54a6 0x8e3475 0x99a242 0x99cc9c 0x973fe9 0x97512f 0x95d725 0x9607b4 0x87e037 0x88485c
/opt/mongodb/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa83fc9]
/opt/mongodb/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x220) [0xa845a0]
/lib/libpthread.so.0(+0xf8f0) [0x7fcb5c6828f0]
/lib/libc.so.6(+0x855e5) [0x7fcb5bbc75e5]
/opt/mongodb/bin/mongod(ZN5mongo20compareElementValuesERKNS_11BSONElementES2+0x2d0) [0x51d300]
/opt/mongodb/bin/mongod(ZN5mongo20fieldIntervalOverlapERKNS_13FieldIntervalES2_RS0+0x228) [0x54cd98]
/opt/mongodb/bin/mongod(ZN5mongo10FieldRangeaNERKS0+0xac) [0x54d0ac]
/opt/mongodb/bin/mongod(_ZN5mongo13FieldRangeSet16processOpElementEPKcRKNS_11BSONElementEbb+0x97) [0x55a617]
/opt/mongodb/bin/mongod(_ZN5mongo13FieldRangeSet17processQueryFieldERKNS_11BSONElementEb+0x4a1) [0x55b501]
/opt/mongodb/bin/mongod(_ZN5mongo13FieldRangeSetC1EPKcRKNS_7BSONObjEbb+0x194) [0x55bdd4]
/opt/mongodb/bin/mongod(_ZN5mongo16MultiPlanScannerC1EPKcRKNS_7BSONObjES5_PKNS_11BSONElementEbS5_S5_bb+0x1f6) [0x8d54a6]
/opt/mongodb/bin/mongod(ZN5mongo25NamespaceDetailsTransient9getCursorEPKcRKNS_7BSONObjES5+0x5e5) [0x8e3475]
/opt/mongodb/bin/mongod(_ZN5mongo12GroupCommand5groupESsRKSsRKNS_7BSONObjES3_SsSsPKcS3_SsRSsRNS_14BSONObjBuilderE+0x332) [0x99a242]
/opt/mongodb/bin/mongod(_ZN5mongo12GroupCommand3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x11ec) [0x99cc9c]
/opt/mongodb/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xb49) [0x973fe9]
/opt/mongodb/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x6ff) [0x97512f]
/opt/mongodb/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x35) [0x95d725]
/opt/mongodb/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0xee4) [0x9607b4]
/opt/mongodb/bin/mongod() [0x87e037]
/opt/mongodb/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x55c) [0x88485c]

Logstream::get called in uninitialized state
Tue Oct 11 09:11:54 ERROR: Client::~Client _context should be null but is not; client:conn
Logstream::get called in uninitialized state
Tue Oct 11 09:11:54 ERROR: Client::shutdown not called: conn
Tue Oct 11 09:11:54 Got signal: 6 (Aborted).

Tue Oct 11 09:11:54 Backtrace:
0xa83fc9 0x7fcb5bb75af0 0x7fcb5bb75a75 0x7fcb5bb795c0 0x7fcb5bb6e941 0x67a48f 0x794b48 0x79aedc 0x57756f 0x579624 0xa9ea30 0x7fcb5c6799ca 0x7fcb5bc2870d
/opt/mongodb/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa83fc9]
/lib/libc.so.6(+0x33af0) [0x7fcb5bb75af0]
/lib/libc.so.6(gsignal+0x35) [0x7fcb5bb75a75]
/lib/libc.so.6(abort+0x180) [0x7fcb5bb795c0]
/lib/libc.so.6(__assert_fail+0xf1) [0x7fcb5bb6e941]
/opt/mongodb/bin/mongod(_ZN5mongo9MongoFile17totalMappedLengthEv+0x20f) [0x67a48f]
/opt/mongodb/bin/mongod(_ZN5mongo15sayMemoryStatusEv+0xd8) [0x794b48]
/opt/mongodb/bin/mongod(_ZN5mongo19ClientCursorMonitor3runEv+0x11c) [0x79aedc]
/opt/mongodb/bin/mongod(_ZN5mongo13BackgroundJob7jobBodyEN5boost10shared_ptrINS0_9JobStatusEEE+0xbf) [0x57756f]
/opt/mongodb/bin/mongod(_ZN5boost6detail11thread_dataINS_3_bi6bind_tIvNS_4_mfi3mf1IvN5mongo13BackgroundJobENS_10shared_ptrINS7_9JobStatusEEEEENS2_5list2INS2_5valueIPS7_EENSD_ISA_EEEEEEE3runEv+0x74) [0x579624]
/opt/mongodb/bin/mongod(thread_proxy+0x80) [0xa9ea30]
/lib/libpthread.so.0(+0x69ca) [0x7fcb5c6799ca]
/lib/libc.so.6(clone+0x6d) [0x7fcb5bc2870d]

Comment by Dennis Hoene [ 06/Oct/11 ]

Got a slightly different backtrace this time:

Thu Oct 6 14:08:20 Invalid access at address: 0

Thu Oct 6 14:08:20 Got signal: 11 (Segmentation fault).

Thu Oct 6 14:08:21 Backtrace:
0xa83fc9 0xa845a0 0x3a5ba0eb10 0x54d7dc 0x83d551 0x83d756 0x83d8b0 0x9697d6 0x8c0b66 0x8cd4b0 0x8cdb06 0x8d21ce 0x8d3be5 0x8d50b7 0x95f299 0x978a27 0x973fe9 0x97512f 0x95d725 0x9607b4
/usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa83fc9]
/usr/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x220) [0xa845a0]
/lib64/libpthread.so.0 [0x3a5ba0eb10]
/usr/bin/mongod(_ZN5mongo24FieldRangeVectorIterator7advanceERKNS_7BSONObjE+0x4c) [0x54d7dc]
/usr/bin/mongod(_ZN5mongo11BtreeCursor29skipOutOfRangeKeysAndCheckEndEv+0x81) [0x83d551]
/usr/bin/mongod(_ZN5mongo11BtreeCursor12skipAndCheckEv+0x26) [0x83d756]
/usr/bin/mongod(_ZN5mongo11BtreeCursor7advanceEv+0x100) [0x83d8b0]
/usr/bin/mongod(_ZN5mongo7CountOp4nextEv+0x846) [0x9697d6]
/usr/bin/mongod(_ZN5mongo12QueryPlanSet6Runner6nextOpERNS_7QueryOpE+0x56) [0x8c0b66]
/usr/bin/mongod(_ZN5mongo12QueryPlanSet6Runner4nextEv+0x110) [0x8cd4b0]
/usr/bin/mongod(_ZN5mongo12QueryPlanSet6Runner22runUntilFirstCompletesEv+0x56) [0x8cdb06]
/usr/bin/mongod(_ZN5mongo12QueryPlanSet5runOpERNS_7QueryOpE+0x11e) [0x8d21ce]
/usr/bin/mongod(_ZN5mongo16MultiPlanScanner9runOpOnceERNS_7QueryOpE+0x525) [0x8d3be5]
/usr/bin/mongod(_ZN5mongo16MultiPlanScanner5runOpERNS_7QueryOpE+0x17) [0x8d50b7]
/usr/bin/mongod(_ZN5mongo8runCountEPKcRKNS_7BSONObjERSs+0x3b9) [0x95f299]
/usr/bin/mongod(_ZN5mongo8CmdCount3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0xb7) [0x978a27]
/usr/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xb49) [0x973fe9]
/usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x6ff) [0x97512f]
/usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x35) [0x95d725]
/usr/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0xee4) [0x9607b4]

Logstream::get called in uninitialized state
Thu Oct 6 14:08:21 ERROR: Client::~Client _context should be null but is not; client:conn
Logstream::get called in uninitialized state
Thu Oct 6 14:08:21 ERROR: Client::shutdown not called: conn

Generated at Thu Feb 08 03:04:30 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.