[SERVER-9244] Segmentation fault while running overnight on low memory VM Created: 04/Apr/13  Updated: 14/May/13  Resolved: 14/May/13

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: 2.0.8
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Nate Seeley Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

CentOS release 6.4 (Final)


Operating System: Linux
Participants:

 Description   

The mongod server had a segmentation fault while running overnight two nights in a row. I don't know if this is significant, but the virtual machine mongo was running on had very little free memory. We doubled the memory on the virtual machine and the segmentation fault has not reappeared.

The following was in /var/log/mongo/mongod.log.

Tue Apr  2 21:00:49 [conn76] remove mws.rmVirtualMachines query: { pluginId: "simulation" } 179ms
Tue Apr  2 21:00:54 Invalid access at address: 0x7f537df8e3cc
 
Tue Apr  2 21:00:54 Got signal: 11 (Segmentation fault).
 
Tue Apr  2 21:00:54 Backtrace:
0xa9608a 0xa9677c 0x327180f500 0x570d10 0x571335 0x912cff 0x952516 0x8c8e46 0x8d94f0 0x8d9b46 0x8dd740 0x8df035 0x8e03e7 0x944445 0x888fc7 0x88dba9 0xaa0b28 0x638757 0x3271807851 0x32714e890d
 /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x3aa) [0xa9608a]
 /usr/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x22c) [0xa9677c]
 /lib64/libpthread.so.0() [0x327180f500]
 /usr/bin/mongod(_ZNK5mongo10Projection6appendERNS_14BSONObjBuilderERKNS_11BSONElementE+0x7e0) [0x570d10]
 /usr/bin/mongod(_ZNK5mongo10Projection9transformERKNS_7BSONObjERNS_14BSONObjBuilderE+0xf5) [0x571335]
 /usr/bin/mongod(_ZN5mongo22fillQueryResultFromObjERNS_11_BufBuilderINS_16TrivialAllocatorEEEPNS_10ProjectionERKNS_7BSONObjEPNS_7DiskLocE+0xaf) [0x912cff]
 /usr/bin/mongod(_ZN5mongo11UserQueryOp4nextEv+0xf06) [0x952516]
 /usr/bin/mongod(_ZN5mongo12QueryPlanSet6Runner6nextOpERNS_7QueryOpE+0x56) [0x8c8e46]
 /usr/bin/mongod(_ZN5mongo12QueryPlanSet6Runner4nextEv+0x110) [0x8d94f0]
 /usr/bin/mongod(_ZN5mongo12QueryPlanSet6Runner22runUntilFirstCompletesEv+0x56) [0x8d9b46]
 /usr/bin/mongod(_ZN5mongo12QueryPlanSet5runOpERNS_7QueryOpE+0x50) [0x8dd740]
 /usr/bin/mongod(_ZN5mongo16MultiPlanScanner9runOpOnceERNS_7QueryOpE+0x525) [0x8df035]
 /usr/bin/mongod(_ZN5mongo16MultiPlanScanner5runOpERNS_7QueryOpE+0x17) [0x8e03e7]
 /usr/bin/mongod(_ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1_+0xfa5) [0x944445]
 /usr/bin/mongod() [0x888fc7]
 /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x559) [0x88dba9]
 /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x78) [0xaa0b28]
 /usr/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x287) [0x638757]
 /lib64/libpthread.so.0() [0x3271807851]
 /lib64/libc.so.6(clone+0x6d) [0x32714e890d]
 
Logstream::get called in uninitialized state
Tue Apr  2 21:00:54 ERROR: Client::~Client _context should be null but is not; client:conn
Logstream::get called in uninitialized state
Tue Apr  2 21:00:54 ERROR: Client::shutdown not called: conn



 Comments   
Comment by Stennie Steneker (Inactive) [ 14/May/13 ]

Hi Nate,

Thank you for the update. I will close this issue since there are no further details to investigate at this time.

If you are able to reproduce this issue please feel free to reopen with additional details.

Regards,
Stephen

Comment by Nate Seeley [ 06/May/13 ]

Unfortunately the log file covering the time of the crashes is no longer available.

We have since allocated more memory to the VMs running MongoDB as we suspected low memory might be related to the seg fault. The issue has not reoccurred.

Comment by Ian Daniel [ 06/May/13 ]

Hi Nate,

Do you still have the log file covering the time of the crashes? If so, please could you attach it.

Has the issue occurred again since then?

Kind regards,
Ian

Generated at Thu Feb 08 03:19:48 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.