[SERVER-16973] Fatal Assertion 18750 Created: 21/Jan/15  Updated: 18/Feb/15  Resolved: 18/Feb/15

Status: Closed
Project: Core Server
Component/s: Replication, WiredTiger
Affects Version/s: 2.8.0-rc5
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Eitan Klein Assignee: Eric Milkie
Resolution: Incomplete Votes: 0
Labels: 28qa
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Zip Archive eitan5-NewPrimary.zip     Zip Archive rs11a - Copy.zip     Text File rs11a.txt     Text File rs12b.txt     Text File rs3 - Copy.txt    
Issue Links:
Related
Operating System: ALL
Steps To Reproduce:

MongoEnv - 3 replica set members
OS: Windows 2012
MongoD - attached to Debugger (windbg)

hammer.mongo
https://github.com/rzh/hammer.mongo

I’m running w/ the command line below
-initdb=false –server ip:port –profile=INSERT –totaltime=52000 –worker=90 –rps=0

Participants:

 Description   

I'm running pre RC6 build from 1/20/2014

It happened while mongod was running attached to debugger, windbg configured to dump a breakpoint stack and go,
see command below
bp mongod!__evict_review "k;g"
The Rs12b contains the Fassert information

You can get the fassert dump at:

EitanRs2:SECONDARY> rs.status()
{
"set" : "EitanRs2",
"date" : ISODate("2015-01-21T22:01:49.928Z"),
"myState" : 2,
"members" : [

{ "_id" : 0, "name" : "eitan6:4001", "health" : 0, "state" : 8, "stateStr" : "(not reachable/healthy)", "uptime" : 0, "optime" : Timestamp(0, 0), "optimeDate" : ISODate("1970-01-01T00:00:00Z"), "lastHeartbeat" : ISODate("2015-01-21T22:01:48.321Z"), "lastHeartbeatRecv" : ISODate("2015-01-21T21:13:44.762Z" ), "pingMs" : 2, "lastHeartbeatMessage" : "Failed attempt to connect to e itan6:4001; couldn't connect to server eitan6:4001 (10.4.111.166), connection at tempt failed", "configVersion" : -1 }

,

{ "_id" : 1, "name" : "Eitan6:4000", "health" : 0, "state" : 8, "stateStr" : "(not reachable/healthy)", "uptime" : 0, "optime" : Timestamp(0, 0), "optimeDate" : ISODate("1970-01-01T00:00:00Z"), "lastHeartbeat" : ISODate("2015-01-21T22:01:49.764Z"), "lastHeartbeatRecv" : ISODate("2015-01-21T19:12:40.846Z" ), "pingMs" : 1, "lastHeartbeatMessage" : "Failed attempt to connect to E itan6:4000; couldn't connect to server Eitan6:4000 (10.4.111.166), connection at tempt failed", "configVersion" : -1 }

,

{ "_id" : 2, "name" : "Eitan5:5000", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 19874, "optime" : Timestamp(1421874832, 761), "optimeDate" : ISODate("2015-01-21T21:13:52Z"), "infoMessage" : "could not find member to sync from", "configVersion" : 3, "self" : true }

],
"ok" : 1
}

EitanRs2:SECONDARY>
net use \\eitan6\tmp /u:administator Admin01
Dump located: \\eitan6\tmp\crash2today.dmp

00000038`6a90f168 00007ffc`41448972 ntdll!NtTerminateProcess+0xa
*** ERROR: Symbol file could not be found.  Defaulted to export symbols for kernel32.dll - 
00000038`6a90f170 00007ffc`40aa5086 ntdll!RtlExitUserProcess+0x82
*** WARNING: Unable to verify checksum for mongod.exe
00000038`6a90f1a0 00007ff6`d4f2ccb4 kernel32!ExitProcess+0xa
(Inline Function) --------`-------- mongod!__crtExitProcess+0x11 [f:\dd\vctools\crt\crtw32\startup\crt0dat.c @ 774]
00000038`6a90f1d0 00007ff6`d4c0a8b9 mongod!doexit+0x17c [f:\dd\vctools\crt\crtw32\startup\crt0dat.c @ 678]
00000038`6a90f240 00007ff6`d4bc82c0 mongod!mongo::quickExit+0x9 [c:\data\mci\shell\src\src\mongo\util\quick_exit.cpp @ 54]
00000038`6a90f270 00007ff6`d4a3df17 mongod!mongo::fassertFailedNoTrace+0xc0 [c:\data\mci\shell\src\src\mongo\util\assert_util.cpp @ 174]
00000038`6a90f310 00007ff6`d49d445a mongod!mongo::repl::syncRollback+0x197 [c:\data\mci\shell\src\src\mongo\db\repl\rs_rollback.cpp @ 811]
00000038`6a90f420 00007ff6`d49d5816 mongod!mongo::repl::BackgroundSync::_rollbackIfNeeded+0x58a [c:\data\mci\shell\src\src\mongo\db\repl\bgsync.cpp @ 427]
00000038`6a90f7f0 00007ff6`d49d3a3a mongod!mongo::repl::BackgroundSync::produce+0x406 [c:\data\mci\shell\src\src\mongo\db\repl\bgsync.cpp @ 261]
00000038`6a90fbd0 00007ff6`d49d5e76 mongod!mongo::repl::BackgroundSync::_producerThread+0x9a [c:\data\mci\shell\src\src\mongo\db\repl\bgsync.cpp @ 199]
00000038`6a90fc30 00007ff6`d4c2d751 mongod!mongo::repl::BackgroundSync::producerThread+0x86 [c:\data\mci\shell\src\src\mongo\db\repl\bgsync.cpp @ 152]
00000038`6a90fd70 00007ff6`d4f30a87 mongod!boost::`anonymous namespace'::thread_start_function+0x21 [c:\data\mci\shell\src\src\third_party\boost\libs\thread\src\win32\thread.cpp @ 185]
00000038`6a90fdb0 00007ff6`d4f30c2e mongod!_callthreadstartex+0x17 [f:\dd\vctools\crt\crtw32\startup\threadex.c @ 376]
00000038`6a90fde0 00007ffc`40aa15cd mongod!_threadstartex+0x102 [f:\dd\vctools\crt\crtw32\startup\threadex.c @ 354]
00000038`6a90fe10 00007ffc`414943d1 kernel32!BaseThreadInitThunk+0xd
00000038`6a90fe40 00000000`00000000 ntdll!RtlUserThreadStart+0x1d



 Comments   
Comment by Eric Milkie [ 04/Feb/15 ]

This may have been fixed by SERVER-17114, can you confirm?

Generated at Thu Feb 08 03:42:52 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.