[SERVER-16899] Mongo shell crashes when interrupting inserts in sharded environment Created: 16/Jan/15  Updated: 31/Jul/16  Resolved: 31/Jul/16

Status: Closed
Project: Core Server
Component/s: Shell
Affects Version/s: 2.8.0-rc5, 3.0.2
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Charlie Swanson Assignee: Unassigned
Resolution: Duplicate Votes: 1
Labels: 28qa
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Text File commands.txt     Text File config-mongod.log     Text File mongos.log     Text File shard01-mongod.log     Text File shard02-mongod.log    
Issue Links:
Duplicate
duplicates SERVER-23168 Shell killOperationsOnAllConnections ... Closed
Related
is related to SERVER-22031 mongo shell output Assertion Closed
Operating System: ALL
Steps To Reproduce:

1. Start a sharded cluster (doesn't seem to matter setup much, so I started the simplest: 1 config, 1 mongos, 2 shards, each a standalone).

$ mkdir /data/test2
$ mlaunch init --single --dir /data/test2 --binarypath=. --sharded 2 --config 1 --mongos 1 --port 30000
launching: ./mongod on port 30001
launching: ./mongod on port 30002
launching: config server on port 30003
launching: ./mongos on port 30000
adding shards.

2. Insert some documents (note: doesn't crash unless some documents exist before next steps)

$ ./mongo --port 30000                                                                                           
MongoDB shell version: 2.8.0-rc3-pre-
connecting to: 127.0.0.1:30000/test
mongos> for (var i = 0; i < 1000; i += 1) { db.foo.insert({i: i}) }
WriteResult({ "nInserted" : 1 })

3. Shard that collection.

mongos> db.foo.ensureIndex({i: 1})
{
        "raw" : {
                "charlie-macbook-pro:30001" : {
                        "createdCollectionAutomatically" : false,
                        "numIndexesBefore" : 1,
                        "numIndexesAfter" : 2,
                        "ok" : 1
                }
        },
        "ok" : 1
}
mongos> use admin
switched to db admin
mongos> db.runCommand({enableSharding: 'test.foo'})
{ "ok" : 1 }
mongos> db.runCommand({shardCollection: 'test.foo', key: {i: 1}})
{ "collectionsharded" : "test.foo", "ok" : 1 }

4. Insert some more documents, but interrupt the for loop

mongos> use test
switched to db test
mongos> for (var i = 1000; i < 5000; i += 1) { db.foo.insert({i: i}) }

5. Crash

^C2015-01-16T11:14:41.763-0500 I -        Assertion: 13111:field not found, expected type 2
2015-01-16T11:14:41.766-0500 I CONTROL  
 0x10cf72a7a 0x10cf2614e 0x10cf13762 0x10cf1360a 0x10cdbce9c 0x10cdba691 0x10cf06661 0x10cdb47dd 0x10cdb4829 0x7fff9a99ef1a 0x10d20106b 0x10cf2e22d 0x10cf2efe2 0x10ce059c6 0x10ce18de3 0x10ce00d73 0x10ce07504 0x10ced6db3 0x10cec94e2 0x35379a0780f9 0x35379a0a8bbb 0x35379a0613a9 0x35379a060783 0x35379a054b05 0x35379a00c7ee
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"10CDB3000","o":"1BFA7A"},{"b":"10CDB3000","o":"17314E"},{"b":"10CDB3000","o":"160762"},{"b":"10CDB3000","o":"16060A"},{"b":"10CDB3000","o":"9E9C"},{"b":"10CDB3000","o":"7691"},{"b":"10CDB3000","o":"153661"},{"b":"10CDB3000","o":"17DD"},{"b":"10CDB3000","o":"1829"},{"b":"7FFF9A99A000","o":"4F1A"},{"b":"10CDB3000","o":"44E06B"},{"b":"10CDB3000","o":"17B22D"},{"b":"10CDB3000","o":"17BFE2"},{"b":"10CDB3000","o":"529C6"},{"b":"10CDB3000","o":"65DE3"},{"b":"10CDB3000","o":"4DD73"},{"b":"10CDB3000","o":"54504"},{"b":"10CDB3000","o":"123DB3"},{"b":"10CDB3000","o":"1164E2"},{"b":"0","o":"35379A0780F9"},{"b":"0","o":"35379A0A8BBB"},{"b":"0","o":"35379A0613A9"},{"b":"0","o":"35379A060783"},{"b":"0","o":"35379A054B05"},{"b":"0","o":"35379A00C7EE"}],"processInfo":{ "mongodbVersion" : "2.8.0-rc3-pre-", "gitVersion" : "de16932890952898881673fdd76c5f45d6dc49e1", "uname" : { "sysname" : "Darwin", "release" : "14.0.0", "version" : "Darwin Kernel Version 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64", "machine" : "x86_64" }, "somap" : [ { "path" : "/Users/charlie/github/mongo/./mongo", "machType" : 2, "b" : "10CDB3000", "buildId" : "B859FB1969F43AC0AD324A464C6E9175" }, { "path" : "/usr/lib/libSystem.B.dylib", "machType" : 6, "b" : "7FFF8EB3C000", "buildId" : "DA954461EC6A3DF085516FC810627627" }, { "path" : "/usr/lib/libc++.1.dylib", "machType" : 6, "b" : "7FFF96327000", "buildId" : "1B9530FD989B3174BB1CBDC159501710" }, { "path" : "/usr/lib/system/libcache.dylib", "machType" : 6, "b" : "7FFF98C1C000", "buildId" : "45E9A2E799C436B2BEE30C4E11614AD1" }, { "path" : "/usr/lib/system/libcommonCrypto.dylib", "machType" : 6, "b" : "7FFF9A5D1000", "buildId" : "D381EBC669D831D380845A80A32CB748" }, { "path" : "/usr/lib/system/libcompiler_rt.dylib", "machType" : 6, "b" : "7FFF948BE000", "buildId" : "BF8FC133EE103DA69B9092039E28678F" }, { "path" : "/usr/lib/system/libcopyfile.dylib", "machType" : 6, "b" : "7FFF8E4F1000", "buildId" : "0C68D3A6ACDD3EF3991ACC82C32AB836" }, { "path" : "/usr/lib/system/libcorecrypto.dylib", "machType" : 6, "b" : "7FFF8B689000", "buildId" : "E178980139853949B7366B3378873301" }, { "path" : "/usr/lib/system/libdispatch.dylib", "machType" : 6, "b" : "7FFF8FA05000", "buildId" : "502CF32B669B3709886208188225E4F0" }, { "path" : "/usr/lib/system/libdyld.dylib", "machType" : 6, "b" : "7FFF900F9000", "buildId" : "19FAF435C16533749DEFD7BBA7D61DB6" }, { "path" : "/usr/lib/system/libkeymgr.dylib", "machType" : 6, "b" : "7FFF8FA30000", "buildId" : "77845842DE703CC5BD01C3D14227CED5" }, { "path" : "/usr/lib/system/liblaunch.dylib", "machType" : 6, "b" : "7FFF8E1D0000", "buildId" : "8A9889248BE735FEBF7D322E90EFE49E" }, { "path" : "/usr/lib/system/libmacho.dylib", "machType" : 6, "b" : "7FFF9A7C4000", "buildId" : "126CA2EDDE91308F8881B9DAEC3C63B6" }, { "path" : "/usr/lib/system/libquarantine.dylib", "machType" : 6, "b" : "7FFF9A02B000", "buildId" : "DC0416272D92361CBABFA869A5C72293" }, { "path" : "/usr/lib/system/libremovefile.dylib", "machType" : 6, "b" : "7FFF9096B000", "buildId" : "3485B5F46CE83C628DFD8736ED6E8531" }, { "path" : "/usr/lib/system/libsystem_asl.dylib", "machType" : 6, "b" : "7FFF9283F000", "buildId" : "F153AC5B0542356E88C820A62CA704E2" }, { "path" : "/usr/lib/system/libsystem_blocks.dylib", "machType" : 6, "b" : "7FFF94099000", "buildId" : "9615D10AFCA73BE4AA1A1B195DACE1A1" }, { "path" : "/usr/lib/system/libsystem_c.dylib", "machType" : 6, "b" : "7FFF8E32E000", "buildId" : "C185E86274243210B5286B822577A4B8" }, { "path" : "/usr/lib/system/libsystem_configuration.dylib", "machType" : 6, "b" : "7FFF9409B000", "buildId" : "9FBA1CE497D0347EA44393ED94512E92" }, { "path" : "/usr/lib/system/libsystem_coreservices.dylib", "machType" : 6, "b" : "7FFF94FFD000", "buildId" : "41B7C5785A5331C8A96FC73E030B0938" }, { "path" : "/usr/lib/system/libsystem_coretls.dylib", "machType" : 6, "b" : "7FFF8C9DB000", "buildId" : "EBBF7EF680D83F8F825CB412BD6D22C0" }, { "path" : "/usr/lib/system/libsystem_dnssd.dylib", "machType" : 6, "b" : "7FFF986C5000", "buildId" : "62B70ECAE40D3C63896E7F00EC386DDB" }, { "path" : "/usr/lib/system/libsystem_info.dylib", "machType" : 6, "b" : "7FFF99B04000", "buildId" : "B85A85D585303A93B0C34DEC41F79478" }, { "path" : "/usr/lib/system/libsystem_kernel.dylib", "machType" : 6, "b" : "7FFF92821000", "buildId" : "93E0E0A975B63904BB4E4BC7C05F4B6B" }, { "path" : "/usr/lib/system/libsystem_m.dylib", "machType" : 6, "b" : "7FFF90C0A000", "buildId" : "1E12AB456D9636D0A226F24D9FB0D9D6" }, { "path" : "/usr/lib/system/libsystem_malloc.dylib", "machType" : 6, "b" : "7FFF9A8D8000", "buildId" : "19BCC25757173502A71F95D65AFA861B" }, { "path" : "/usr/lib/system/libsystem_network.dylib", "machType" : 6, "b" : "7FFF972DF000", "buildId" : "C0B2313D47BE38A9BEE62634A4F5E14B" }, { "path" : "/usr/lib/system/libsystem_networkextension.dylib", "machType" : 6, "b" : "7FFF9A78E000", "buildId" : "29AB225BD7FB30ED960065D44B9A9442" }, { "path" : "/usr/lib/system/libsystem_notify.dylib", "machType" : 6, "b" : "7FFF922EB000", "buildId" : "61147800F3203DAA850CBADF33855F29" }, { "path" : "/usr/lib/system/libsystem_platform.dylib", "machType" : 6, "b" : "7FFF9A99A000", "buildId" : "64E34079D7123D669CE2418624A5C040" }, { "path" : "/usr/lib/system/libsystem_pthread.dylib", "machType" : 6, "b" : "7FFF90C48000", "buildId" : "26B1897F0CD330F3B55A37CB45062D73" }, { "path" : "/usr/lib/system/libsystem_sandbox.dylib", "machType" : 6, "b" : "7FFF97395000", "buildId" : "DB9962EF889831CC9B87E01F8CE74C9D" }, { "path" : "/usr/lib/system/libsystem_secinit.dylib", "machType" : 6, "b" : "7FFF9015A000", "buildId" : "581DAD0F6B633A48B63B917AF799ABAA" }, { "path" : "/usr/lib/system/libsystem_stats.dylib", "machType" : 6, "b" : "7FFF8EADB000", "buildId" : "1DB0443659743F1686CC5FF5F390339C" }, { "path" : "/usr/lib/system/libsystem_trace.dylib", "machType" : 6, "b" : "7FFF98BA7000", "buildId" : "A9E6B7D8C3273742AC5486C94218B1DF" }, { "path" : "/usr/lib/system/libunc.dylib", "machType" : 6, "b" : "7FFF90754000", "buildId" : "5676F7EAC1DF329FB006D2C3022B7D70" }, { "path" : "/usr/lib/system/libunwind.dylib", "machType" : 6, "b" : "7FFF8B745000", "buildId" : "BE7E51A0B6EA3A549CCA9D88F683A6D6" }, { "path" : "/usr/lib/system/libxpc.dylib", "machType" : 6, "b" : "7FFF922F5000", "buildId" : "9437C02EA07B38C891CB299FAA63083D" }, { "path" : "/usr/lib/libobjc.A.dylib", "machType" : 6, "b" : "7FFF98D3D000", "buildId" : "3B60CD9074A23A5D9686B0772159792A" }, { "path" : "/usr/lib/libauto.dylib", "machType" : 6, "b" : "7FFF8CBFB000", "buildId" : "A260789BD4D8316A9490254767B8A5F1" }, { "path" : "/usr/lib/libc++abi.dylib", "machType" : 6, "b" : "7FFF91E4D000", "buildId" : "88A22A0F87C63002BFBAAC0F2808B8B9" }, { "path" : "/usr/lib/libDiagnosticMessagesClient.dylib", "machType" : 6, "b" : "7FFF90B8F000", "buildId" : "2EE8E4365CDC34C599595BA218D507FB" } ] }}
 mongo(_ZN5mongo15printStackTraceERNSt3__113basic_ostreamIcNS0_11char_traitsIcEEEE+0x3A) [0x10cf72a7a]
 mongo(_ZN5mongo10logContextEPKc+0x10E) [0x10cf2614e]
 mongo(_ZN5mongo11msgassertedEiPKc+0x152) [0x10cf13762]
 mongo(_ZN5mongo11msgassertedEiRKNSt3__112basic_stringIcNS0_11char_traitsIcEENS0_9allocatorIcEEEE+0x1A) [0x10cf1360a]
 mongo(_ZNK5mongo11BSONElement3chkEi+0x35C) [0x10cdbce9c]
 mongo(_ZNK5mongo11BSONElement6StringEv+0x21) [0x10cdba691]
 mongo(_ZNK5mongo11shell_utils18ConnectionRegistry30killOperationsOnAllConnectionsEb+0x391) [0x10cf06661]
 mongo(_ZN5mongo11exitCleanlyENS_8ExitCodeE+0x6D) [0x10cdb47dd]
 mongo(_Z10quitNicelyi+0x9) [0x10cdb4829]
 libsystem_platform.dylib(_sigtramp+0x1A) [0x7fff9a99ef1a]
 mongo(_ZN2v88internal6Parser26ParseConditionalExpressionEbPb+0x2B) [0x10d20106b]
 mongo(_ZN5mongo13MessagingPort4recvERNS_7MessageE+0x7D) [0x10cf2e22d]
 mongo(_ZN5mongo13MessagingPort4recvERKNS_7MessageERS1_+0x22) [0x10cf2efe2]
 mongo(_ZN5mongo18DBClientConnection4callERNS_7MessageES2_bPNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x46) [0x10ce059c6]
 mongo(_ZN5mongo14DBClientCursor4initEv+0x93) [0x10ce18de3]
 mongo(_ZN5mongo12DBClientBase5queryERKNSt3__112basic_stringIcNS1_11char_traitsIcEENS1_9allocatorIcEEEENS_5QueryEiiPKNS_7BSONObjEii+0xA3) [0x10ce00d73]
 mongo(_ZN5mongo18DBClientConnection5queryERKNSt3__112basic_stringIcNS1_11char_traitsIcEENS1_9allocatorIcEEEENS_5QueryEiiPKNS_7BSONObjEii+0x84) [0x10ce07504]
 mongo(_ZN5mongo9mongoFindEPNS_7V8ScopeERKN2v89ArgumentsE+0x2C3) [0x10ced6db3]
 mongo(_ZN5mongo7V8Scope10v8CallbackERKN2v89ArgumentsE+0x52) [0x10cec94e2]
 ??? [0x35379a0780f9]
 ??? [0x35379a0a8bbb]
 ??? [0x35379a0613a9]
 ??? [0x35379a060783]
 ??? [0x35379a054b05]
 ??? [0x35379a00c7ee]
-----  END BACKTRACE  -----
2015-01-16T11:14:41.768-0500 F -        terminate() called. An exception is active; attempting to gather more information
2015-01-16T11:14:41.771-0500 F -        DBException::toString(): 13111 field not found, expected type 2
Actual exception type: mongo::MsgAssertionException
 
 0x10cf72a7a 0x10cf72172 0x7fff91e730a1 0x7fff91e72b30 0x10cf137f7 0x10cf1360a 0x10cdbce9c 0x10cdba691 0x10cf06661 0x10cdb47dd 0x10cdb4829 0x7fff9a99ef1a 0x10d20106b 0x10cf2e22d 0x10cf2efe2 0x10ce059c6 0x10ce18de3 0x10ce00d73 0x10ce07504 0x10ced6db3 0x10cec94e2 0x35379a0780f9 0x35379a0a8bbb 0x35379a0613a9 0x35379a060783 0x35379a054b05 0x35379a00c7ee
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"10CDB3000","o":"1BFA7A"},{"b":"10CDB3000","o":"1BF172"},{"b":"7FFF91E4D000","o":"260A1"},{"b":"7FFF91E4D000","o":"25B30"},{"b":"10CDB3000","o":"1607F7"},{"b":"10CDB3000","o":"16060A"},{"b":"10CDB3000","o":"9E9C"},{"b":"10CDB3000","o":"7691"},{"b":"10CDB3000","o":"153661"},{"b":"10CDB3000","o":"17DD"},{"b":"10CDB3000","o":"1829"},{"b":"7FFF9A99A000","o":"4F1A"},{"b":"10CDB3000","o":"44E06B"},{"b":"10CDB3000","o":"17B22D"},{"b":"10CDB3000","o":"17BFE2"},{"b":"10CDB3000","o":"529C6"},{"b":"10CDB3000","o":"65DE3"},{"b":"10CDB3000","o":"4DD73"},{"b":"10CDB3000","o":"54504"},{"b":"10CDB3000","o":"123DB3"},{"b":"10CDB3000","o":"1164E2"},{"b":"0","o":"35379A0780F9"},{"b":"0","o":"35379A0A8BBB"},{"b":"0","o":"35379A0613A9"},{"b":"0","o":"35379A060783"},{"b":"0","o":"35379A054B05"},{"b":"0","o":"35379A00C7EE"}],"processInfo":{ "mongodbVersion" : "2.8.0-rc3-pre-", "gitVersion" : "de16932890952898881673fdd76c5f45d6dc49e1", "uname" : { "sysname" : "Darwin", "release" : "14.0.0", "version" : "Darwin Kernel Version 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64", "machine" : "x86_64" }, "somap" : [ { "path" : "/Users/charlie/github/mongo/./mongo", "machType" : 2, "b" : "10CDB3000", "buildId" : "B859FB1969F43AC0AD324A464C6E9175" }, { "path" : "/usr/lib/libSystem.B.dylib", "machType" : 6, "b" : "7FFF8EB3C000", "buildId" : "DA954461EC6A3DF085516FC810627627" }, { "path" : "/usr/lib/libc++.1.dylib", "machType" : 6, "b" : "7FFF96327000", "buildId" : "1B9530FD989B3174BB1CBDC159501710" }, { "path" : "/usr/lib/system/libcache.dylib", "machType" : 6, "b" : "7FFF98C1C000", "buildId" : "45E9A2E799C436B2BEE30C4E11614AD1" }, { "path" : "/usr/lib/system/libcommonCrypto.dylib", "machType" : 6, "b" : "7FFF9A5D1000", "buildId" : "D381EBC669D831D380845A80A32CB748" }, { "path" : "/usr/lib/system/libcompiler_rt.dylib", "machType" : 6, "b" : "7FFF948BE000", "buildId" : "BF8FC133EE103DA69B9092039E28678F" }, { "path" : "/usr/lib/system/libcopyfile.dylib", "machType" : 6, "b" : "7FFF8E4F1000", "buildId" : "0C68D3A6ACDD3EF3991ACC82C32AB836" }, { "path" : "/usr/lib/system/libcorecrypto.dylib", "machType" : 6, "b" : "7FFF8B689000", "buildId" : "E178980139853949B7366B3378873301" }, { "path" : "/usr/lib/system/libdispatch.dylib", "machType" : 6, "b" : "7FFF8FA05000", "buildId" : "502CF32B669B3709886208188225E4F0" }, { "path" : "/usr/lib/system/libdyld.dylib", "machType" : 6, "b" : "7FFF900F9000", "buildId" : "19FAF435C16533749DEFD7BBA7D61DB6" }, { "path" : "/usr/lib/system/libkeymgr.dylib", "machType" : 6, "b" : "7FFF8FA30000", "buildId" : "77845842DE703CC5BD01C3D14227CED5" }, { "path" : "/usr/lib/system/liblaunch.dylib", "machType" : 6, "b" : "7FFF8E1D0000", "buildId" : "8A9889248BE735FEBF7D322E90EFE49E" }, { "path" : "/usr/lib/system/libmacho.dylib", "machType" : 6, "b" : "7FFF9A7C4000", "buildId" : "126CA2EDDE91308F8881B9DAEC3C63B6" }, { "path" : "/usr/lib/system/libquarantine.dylib", "machType" : 6, "b" : "7FFF9A02B000", "buildId" : "DC0416272D92361CBABFA869A5C72293" }, { "path" : "/usr/lib/system/libremovefile.dylib", "machType" : 6, "b" : "7FFF9096B000", "buildId" : "3485B5F46CE83C628DFD8736ED6E8531" }, { "path" : "/usr/lib/system/libsystem_asl.dylib", "machType" : 6, "b" : "7FFF9283F000", "buildId" : "F153AC5B0542356E88C820A62CA704E2" }, { "path" : "/usr/lib/system/libsystem_blocks.dylib", "machType" : 6, "b" : "7FFF94099000", "buildId" : "9615D10AFCA73BE4AA1A1B195DACE1A1" }, { "path" : "/usr/lib/system/libsystem_c.dylib", "machType" : 6, "b" : "7FFF8E32E000", "buildId" : "C185E86274243210B5286B822577A4B8" }, { "path" : "/usr/lib/system/libsystem_configuration.dylib", "machType" : 6, "b" : "7FFF9409B000", "buildId" : "9FBA1CE497D0347EA44393ED94512E92" }, { "path" : "/usr/lib/system/libsystem_coreservices.dylib", "machType" : 6, "b" : "7FFF94FFD000", "buildId" : "41B7C5785A5331C8A96FC73E030B0938" }, { "path" : "/usr/lib/system/libsystem_coretls.dylib", "machType" : 6, "b" : "7FFF8C9DB000", "buildId" : "EBBF7EF680D83F8F825CB412BD6D22C0" }, { "path" : "/usr/lib/system/libsystem_dnssd.dylib", "machType" : 6, "b" : "7FFF986C5000", "buildId" : "62B70ECAE40D3C63896E7F00EC386DDB" }, { "path" : "/usr/lib/system/libsystem_info.dylib", "machType" : 6, "b" : "7FFF99B04000", "buildId" : "B85A85D585303A93B0C34DEC41F79478" }, { "path" : "/usr/lib/system/libsystem_kernel.dylib", "machType" : 6, "b" : "7FFF92821000", "buildId" : "93E0E0A975B63904BB4E4BC7C05F4B6B" }, { "path" : "/usr/lib/system/libsystem_m.dylib", "machType" : 6, "b" : "7FFF90C0A000", "buildId" : "1E12AB456D9636D0A226F24D9FB0D9D6" }, { "path" : "/usr/lib/system/libsystem_malloc.dylib", "machType" : 6, "b" : "7FFF9A8D8000", "buildId" : "19BCC25757173502A71F95D65AFA861B" }, { "path" : "/usr/lib/system/libsystem_network.dylib", "machType" : 6, "b" : "7FFF972DF000", "buildId" : "C0B2313D47BE38A9BEE62634A4F5E14B" }, { "path" : "/usr/lib/system/libsystem_networkextension.dylib", "machType" : 6, "b" : "7FFF9A78E000", "buildId" : "29AB225BD7FB30ED960065D44B9A9442" }, { "path" : "/usr/lib/system/libsystem_notify.dylib", "machType" : 6, "b" : "7FFF922EB000", "buildId" : "61147800F3203DAA850CBADF33855F29" }, { "path" : "/usr/lib/system/libsystem_platform.dylib", "machType" : 6, "b" : "7FFF9A99A000", "buildId" : "64E34079D7123D669CE2418624A5C040" }, { "path" : "/usr/lib/system/libsystem_pthread.dylib", "machType" : 6, "b" : "7FFF90C48000", "buildId" : "26B1897F0CD330F3B55A37CB45062D73" }, { "path" : "/usr/lib/system/libsystem_sandbox.dylib", "machType" : 6, "b" : "7FFF97395000", "buildId" : "DB9962EF889831CC9B87E01F8CE74C9D" }, { "path" : "/usr/lib/system/libsystem_secinit.dylib", "machType" : 6, "b" : "7FFF9015A000", "buildId" : "581DAD0F6B633A48B63B917AF799ABAA" }, { "path" : "/usr/lib/system/libsystem_stats.dylib", "machType" : 6, "b" : "7FFF8EADB000", "buildId" : "1DB0443659743F1686CC5FF5F390339C" }, { "path" : "/usr/lib/system/libsystem_trace.dylib", "machType" : 6, "b" : "7FFF98BA7000", "buildId" : "A9E6B7D8C3273742AC5486C94218B1DF" }, { "path" : "/usr/lib/system/libunc.dylib", "machType" : 6, "b" : "7FFF90754000", "buildId" : "5676F7EAC1DF329FB006D2C3022B7D70" }, { "path" : "/usr/lib/system/libunwind.dylib", "machType" : 6, "b" : "7FFF8B745000", "buildId" : "BE7E51A0B6EA3A549CCA9D88F683A6D6" }, { "path" : "/usr/lib/system/libxpc.dylib", "machType" : 6, "b" : "7FFF922F5000", "buildId" : "9437C02EA07B38C891CB299FAA63083D" }, { "path" : "/usr/lib/libobjc.A.dylib", "machType" : 6, "b" : "7FFF98D3D000", "buildId" : "3B60CD9074A23A5D9686B0772159792A" }, { "path" : "/usr/lib/libauto.dylib", "machType" : 6, "b" : "7FFF8CBFB000", "buildId" : "A260789BD4D8316A9490254767B8A5F1" }, { "path" : "/usr/lib/libc++abi.dylib", "machType" : 6, "b" : "7FFF91E4D000", "buildId" : "88A22A0F87C63002BFBAAC0F2808B8B9" }, { "path" : "/usr/lib/libDiagnosticMessagesClient.dylib", "machType" : 6, "b" : "7FFF90B8F000", "buildId" : "2EE8E4365CDC34C599595BA218D507FB" } ] }}
 mongo(_ZN5mongo15printStackTraceERNSt3__113basic_ostreamIcNS0_11char_traitsIcEEEE+0x3A) [0x10cf72a7a]
 mongo(_ZN5mongo12_GLOBAL__N_111myTerminateEv+0x282) [0x10cf72172]
 libc++abi.dylib(_ZSt11__terminatePFvvE+0x8) [0x7fff91e730a1]
 libc++abi.dylib(_ZN10__cxxabiv1L22exception_cleanup_funcE19_Unwind_Reason_CodeP17_Unwind_Exception+0x0) [0x7fff91e72b30]
 mongo(_ZN5mongo11msgassertedEiPKc+0x1E7) [0x10cf137f7]
 mongo(_ZN5mongo11msgassertedEiRKNSt3__112basic_stringIcNS0_11char_traitsIcEENS0_9allocatorIcEEEE+0x1A) [0x10cf1360a]
 mongo(_ZNK5mongo11BSONElement3chkEi+0x35C) [0x10cdbce9c]
 mongo(_ZNK5mongo11BSONElement6StringEv+0x21) [0x10cdba691]
 mongo(_ZNK5mongo11shell_utils18ConnectionRegistry30killOperationsOnAllConnectionsEb+0x391) [0x10cf06661]
 mongo(_ZN5mongo11exitCleanlyENS_8ExitCodeE+0x6D) [0x10cdb47dd]
 mongo(_Z10quitNicelyi+0x9) [0x10cdb4829]
 libsystem_platform.dylib(_sigtramp+0x1A) [0x7fff9a99ef1a]
 mongo(_ZN2v88internal6Parser26ParseConditionalExpressionEbPb+0x2B) [0x10d20106b]
 mongo(_ZN5mongo13MessagingPort4recvERNS_7MessageE+0x7D) [0x10cf2e22d]
 mongo(_ZN5mongo13MessagingPort4recvERKNS_7MessageERS1_+0x22) [0x10cf2efe2]
 mongo(_ZN5mongo18DBClientConnection4callERNS_7MessageES2_bPNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x46) [0x10ce059c6]
 mongo(_ZN5mongo14DBClientCursor4initEv+0x93) [0x10ce18de3]
 mongo(_ZN5mongo12DBClientBase5queryERKNSt3__112basic_stringIcNS1_11char_traitsIcEENS1_9allocatorIcEEEENS_5QueryEiiPKNS_7BSONObjEii+0xA3) [0x10ce00d73]
 mongo(_ZN5mongo18DBClientConnection5queryERKNSt3__112basic_stringIcNS1_11char_traitsIcEENS1_9allocatorIcEEEENS_5QueryEiiPKNS_7BSONObjEii+0x84) [0x10ce07504]
 mongo(_ZN5mongo9mongoFindEPNS_7V8ScopeERKN2v89ArgumentsE+0x2C3) [0x10ced6db3]
 mongo(_ZN5mongo7V8Scope10v8CallbackERKN2v89ArgumentsE+0x52) [0x10cec94e2]
 ??? [0x35379a0780f9]
 ??? [0x35379a0a8bbb]
 ??? [0x35379a0613a9]
 ??? [0x35379a060783]
 ??? [0x35379a054b05]
 ??? [0x35379a00c7ee]
-----  END BACKTRACE  -----

Participants:

 Description   

Mongo shell crashes with backtrace when interrupting a for loop inserting simple documents into a sharded collection. Logs for mongos and mongod's attached.



 Comments   
Comment by Scott Hernandez (Inactive) [ 23/Jan/15 ]

This is due to the change in currentOp format (???) not including "client" in all elements, during this check:

                    if ( uris.count( op[ "client" ].String() ) ) {

"inprog" : [
		{
			"desc" : "conn3",
			"threadId" : "0x7ff490c2d400",
			"connectionId" : 3,
			"opid" : "shard0001:22",
			"active" : true,
			"secs_running" : 5,
			"microsecs_running" : NumberLong(5097620),
			"op" : "query",
			"ns" : "test",
			"query" : {
				"$eval" : "sleep(100000); return false;"
			},
			"client_s" : "127.0.0.1:51139",
			"numYields" : 0,
			"locks" : {
				"Global" : "W",
				"MMAPV1Journal" : "w"
			},
			"waitingForLock" : false,
			"lockStats" : {...

Comment by Charlie Swanson [ 23/Jan/15 ]

No, I can't seem to get it in 2.6. (tried 2.6.5 and 2.6.6)

Comment by Daniel Pasette (Inactive) [ 17/Jan/15 ]

charlies, is this reproducible in 2.6?

Generated at Thu Feb 08 03:42:39 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.