[SERVER-17130] Mongod segfault during insert with WiredTiger Created: 30/Jan/15  Updated: 04/Jun/15  Resolved: 23/Mar/15

Status: Closed
Project: Core Server
Component/s: WiredTiger
Affects Version/s: 3.0.0-rc7
Fix Version/s: None

Type: Bug Priority: Critical - P2
Reporter: Jonathan Abrahams Assignee: Michael Cahill (Inactive)
Resolution: Cannot Reproduce Votes: 0
Labels: 28qa
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Operating System: Linux
Participants:

 Description   

Mongos stress test was running on undersized machines:

  • 4GB memory
  • 3 node replica set

At first the system killed one of the replica nodes when it hit Out Of Memory condition (2015-01-29T22:58:49.832+0000)

Later (2015-01-30T01:38:09.637+0000) the second replica node crashed with a segmentation fault (signal 11)

2015-01-30T01:38:09.637+0000 I REPL     [ReplicationExecutor] Error in heartbeat request to ip-10-168-185-57:32000; Location18915 Failed attempt to connect to ip-10-168-185-57:32000; couldn't connect to server ip-10-168-185-57:32000 (10.168.185.57), connection attempt failed
2015-01-30T01:38:09.708+0000 F -        Got signal: 11 (Segmentation fault).
 
 0xf3a9d9 0xf3a052 0xf3a3ae 0x7f0f592d9340 0x13462c8 0x134a185 0x134c11a 0x131cbf2 0x131d3d6 0x131ae5d 0x131b2ac 0x131c58a 0x7f0f592d1182 0x7f0f583d1fbd
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"400000","o":"B3A9D9"},{"b":"400000","o":"B3A052"},{"b":"400000","o":"B3A3AE"},{"b":"7F0F592C9000","o":"10340"},{"b":"400000","o":"F462C8"},{"b":"400000","o":"F4A185"},{"b":"400000","o":"F4C11A"},{"b":"400000","o":"F1CBF2"},{"b":"400000","o":"F1D3D6"},{"b":"400000","o":"F1AE5D"},{"b":"400000","o":"F1B2AC"},{"b":"400000","o":"F1C58A"},{"b":"7F0F592C9000","o":"8182"},{"b":"7F0F582D7000","o":"FAFBD"}],"processInfo":{ "mongodbVersion" : "3.0.0-rc7", "gitVersion" : "e4c60053b2967e16f765fa25d16aa6d629faa196", "uname" : { "sysname" : "Linux", "release" : "3.13.0-36-generic", "version" : "#63-Ubuntu SMP Wed Sep 3 21:30:07 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7ABEF000", "elfType" : 3 }, { "b" : "7F0F592C9000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3 }, { "b" : "7F0F590C1000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3 }, { "b" : "7F0F58EBD000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3 }, { "b" : "7F0F58BB9000", "path" : "/usr/lib/x86_64-linux-gnu/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F0F588B3000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3 }, { "b" : "7F0F5869D000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F0F582D7000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3 }, { "b" : "7F0F594E7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf3a9d9]
 mongod(+0xB3A052) [0xf3a052]
 mongod(+0xB3A3AE) [0xf3a3ae]
 libpthread.so.0(+0x10340) [0x7f0f592d9340]
 mongod(+0xF462C8) [0x13462c8]
 mongod(+0xF4A185) [0x134a185]
 mongod(__wt_reconcile+0x1AA) [0x134c11a]
 mongod(+0xF1CBF2) [0x131cbf2]
 mongod(__wt_evict+0x96) [0x131d3d6]
 mongod(__wt_evict_page+0x2D) [0x131ae5d]
 mongod(__wt_evict_lru_page+0x26C) [0x131b2ac]
 mongod(+0xF1C58A) [0x131c58a]
 libpthread.so.0(+0x8182) [0x7f0f592d1182]
 libc.so.6(clone+0x6D) [0x7f0f583d1fbd]
-----  END BACKTRACE  -----


Generated at Thu Feb 08 03:43:23 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.