[SERVER-15871] Segmentation fault in secondary rebuilding index in background Created: 30/Oct/14  Updated: 10/Dec/14  Resolved: 05/Dec/14

Status: Closed
Project: Core Server
Component/s: Index Maintenance, Replication
Affects Version/s: 2.6.5
Fix Version/s: None

Type: Bug Priority: Critical - P2
Reporter: Edu Herraiz Assignee: Eric Milkie
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Text File mongo_issue.txt     File mongod.issue15871.log    
Issue Links:
Duplicate
duplicates SERVER-16274 secondary fasserts trying to replicat... Closed
Related
related to SERVER-14494 Dropping collection during active bac... Closed
related to SERVER-15038 Multiple background index builds may ... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Participants:

 Description   

We have a segfault on a secondary node during a background index build:

2014-10-30T05:33:35.382+0100 [repl index builder 83991] build index on: 542-110-6347.keyword_adgroup properties: { v: 1, key: { adgroup: 1 }, name
: "adgroup_1", ns: "542-110-6347.keyword_adgroup", background: true }
2014-10-30T05:33:35.383+0100 [repl index builder 83991]          building index in background
2014-10-30T05:33:35.453+0100 [repl writer worker 4] CMD: drop 542-110-6347.keyword_adgroup
2014-10-30T05:33:35.453+0100 [repl writer worker 4] halting index build: { campaign: 1 }
2014-10-30T05:33:35.453+0100 [repl writer worker 4] SEVERE: Invalid access at address: 0
2014-10-30T05:33:35.461+0100 [repl writer worker 4] SEVERE: Got signal: 11 (Segmentation fault).
...
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0x11e9b11]
 /usr/bin/mongod() [0x11e8eee]
 /usr/bin/mongod() [0x11e8fdf]
 /lib/x86_64-linux-gnu/libpthread.so.0(+0x10340) [0x7f41bf498340]
 /usr/bin/mongod(_ZN5mongo12IndexCatalog23killMatchingIndexBuildsERKNS0_17IndexKillCriteriaE+0x218) [0x8da668]
 /usr/bin/mongod(_ZN5mongo12IndexBuilder23killMatchingIndexBuildsEPNS_10CollectionERKNS_12IndexCatalog17IndexKillCriteriaE+0x15) [0xb8aa95]
 /usr/bin/mongod(_ZN5mongo7CmdDrop15stopIndexBuildsEPNS_8DatabaseERKNS_7BSONObjE+0xe9) [0xa2f5a9]
 /usr/bin/mongod(_ZN5mongo7CmdDrop3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x1c0) [0xa31e80]
 /usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x3a) [0xa2939a]
 /usr/bin/mongod(_ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x19b1) [0xa2b151]
 /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x6c6) [0xa2c9a6]
 /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0x973) [0xe547d3]
 /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x4fe) [0xeb8d9e]
 /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x50) [0xeb96b0]
 /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x19e) [0x117f0ee]
 /usr/bin/mongod() [0x122e4a9]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x8182) [0x7f41bf490182]
 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f41be79530d]
2014-10-30T08:33:23.307+0100 ***** SERVER RESTARTED *****

In the same server we had this two related issues:
SERVER-14494, SERVER-15038

Attached you can see the log trace



 Comments   
Comment by Eric Milkie [ 05/Dec/14 ]

We've identified that this issue is the same as what is described in SERVER-16274; please follow that ticket for updates.
Thank you for reporting this.

Comment by Edu Herraiz [ 30/Oct/14 ]

OK.

Comment by Scott Hernandez (Inactive) [ 30/Oct/14 ]

Can you please provide the full logs for that member? We'd like to see much more before and after the snippet you provided.

Generated at Thu Feb 08 03:39:14 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.