[SERVER-20100] University M102 course Homework 3.2 db.killOp(...) crashes Created: 24/Aug/15  Updated: 08/Jan/24  Resolved: 25/Aug/15

Status: Closed
Project: Core Server
Component/s: Admin
Affects Version/s: 3.0.5
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Imre Dávid Kosztka [X] Assignee: Ramon Fernandez Marina
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File screenshot-1.png    
Operating System: ALL
Steps To Reproduce:

Setup: I use arch linux x64 with the community/mongodb 3.0.5-1 package.
Download: https://university.mongodb.com/static/MongoDB_2015_M102_August/handouts/performance.f67ebce3b4c6.zip
Follow: https://university.mongodb.com/courses/MongoDB/M102/2015_August/courseware/Chapter_3_Performance/537a58e68bb48b7c467a20d8
There is only 1 opid in the db.currentOp(), I used that to do db.killOp(...) the mongo shell version was 3.0.5 too
You can find the trace here too: https://university.mongodb.com/courses/MongoDB/M102/2015_August/discussion/forum/threads/55db82f41ee0d25f2642a142

Participants:

 Description   

I was doing the M102 Homework 3.2 and during the db.killOp(...) the mongod crashed, all the time



 Comments   
Comment by Marc [ 10/Nov/17 ]

I am using MongDB 3.2.17 working M102 course Homework problem 3.2 and was asked to report this bug here:

Using windows 10 with Microsoft Edge.

Here is a link to the Discussion post in the University port.
https://university.mongodb.com/courses/MongoDB/M102/2017_October/discussion/forum/threads/59fb24a7bbc537534b947b9c

And I have tried to attached a screen shot of the error.

Comment by heartsmagic [ 07/Nov/17 ]

Same problem happened for me in the current course. I am using:

  • Ubuntu 16.04
  • MongoDB 3.4.10 from mongodb-org repos.

Here is the backtrace I got:

2017-11-08T00:12:40.947+0300 F -        [thread3] Invalid access at address: 0x7b
2017-11-08T00:12:41.203+0300 F -        [thread3] Got signal: 11 (Segmentation fault).
 
 0x5628794db651 0x5628794da869 0x5628794daed6 0x562879740851 0x7f568494c390 0x5628793d1f61 0x5628793ac2fc 0x562879d5ab10 0x7f56849426ba 0x7f56846783dd
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"562878C37000","o":"8A4651","s":"_ZN5mongo15printStackTraceERSo"},{"b":"562878C37000","o":"8A3869"},{"b":"562878C37000","o":"8A3ED6"},{"b":"562878C37000","o":"B09851"},{"b":"7F568493B000","o":"11390"},{"b":"562878C37000","o":"79AF61","s":"_ZN5mongo5mozjs14JSThreadConfig8JSThread3runEPv"},{"b":"562878C37000","o":"7752FC","s":"_ZN4nspr6Thread13ThreadRoutineEPv"},{"b":"562878C37000","o":"1123B10"},{"b":"7F568493B000","o":"76BA"},{"b":"7F5684571000","o":"1073DD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.4.10", "gitVersion" : "078f28920cb24de0dd479b5ea6c66c644f6326e9", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.4.0-98-generic", "version" : "#121-Ubuntu SMP Tue Oct 10 14:24:03 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "b" : "562878C37000", "elfType" : 3, "buildId" : "3B2370C2497C9E731601F5330F98426EDEC069DB" }, { "b" : "7FFD0E9BE000", "elfType" : 3, "buildId" : "30999EF567346F2D006F2EE03E2A4D94CD144519" }, { "b" : "7F56858C7000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "675F454AD6FD0B6CA2E41127C7B98079DA37F7B6" }, { "b" : "7F5685483000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "2DA08A7E5BF610030DD33B70DB951399626B7496" }, { "b" : "7F568527B000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "F951C1E0765FCAE48F82CAFE35D1ADD36D6C9AF9" }, { "b" : "7F5685077000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "0FC788F0861846257B5F1773FBD438E95DFC1032" }, { "b" : "7F5684D6E000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "FF7A33D389E756CA381A8189291A968EA5E1F4F8" }, { "b" : "7F5684B58000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "68220AE2C65D65C1B6AAA12FA6765A6EC2F5F434" }, { "b" : "7F568493B000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "27F189EF8DB8C3734C6A678E6EF3CB0B206D58B2" }, { "b" : "7F5684571000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "088A6E00A1814622219F346B41E775B8DD46C518" }, { "b" : "7F5685B30000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "9157F205547F0EB588E2AB1F2F120B74253A43EA" } ] }}
 mongo(_ZN5mongo15printStackTraceERSo+0x41) [0x5628794db651]
 mongo(+0x8A3869) [0x5628794da869]
 mongo(+0x8A3ED6) [0x5628794daed6]
 mongo(+0xB09851) [0x562879740851]
 libpthread.so.0(+0x11390) [0x7f568494c390]
 mongo(_ZN5mongo5mozjs14JSThreadConfig8JSThread3runEPv+0xA1) [0x5628793d1f61]
 mongo(_ZN4nspr6Thread13ThreadRoutineEPv+0x1C) [0x5628793ac2fc]
 mongo(+0x1123B10) [0x562879d5ab10]
 libpthread.so.0(+0x76BA) [0x7f56849426ba]
 libc.so.6(clone+0x6D) [0x7f56846783dd]
-----  END BACKTRACE  -----
[1]    1078 segmentation fault (core dumped)  mongo --shell performance performance.js

Comment by Ramon Fernandez Marina [ 29/Jan/16 ]

For the record, SERVER-22334 shows how a missing "var" keyword in the JS code could trigger this issue. MongoDB 3.2 uses SpiderMonkey as the JavaScript engine an it handles this case better than V8.

Comment by Ramon Fernandez Marina [ 25/Aug/15 ]

NoniusSenior, I was't able to reproduce this behavior. The following line in the stack trace:

mongod(_ZN2v82V837AdjustAmountOfExternalAllocatedMemoryEl+0x16) [0x11e9e46]

indicates some system limitation is hampering V8's ability to manage memory. I'd recommend you verify other limits in your system (e.g.: ulimit, cgroups) and make sure that V8 can allocate memory as needed.

I checked with the M102 administrators, and looks like you're the only one to run into this issue among thousands of students. A member of our Education team will follow up with you in the course forums.

Thanks,
Ramón.

Comment by Imre Dávid Kosztka [X] [ 25/Aug/15 ]

Neither of them is running on my machine.

Comment by Ramon Fernandez Marina [ 24/Aug/15 ]

NoniusSenior, I currently don't have access to some of the links above, I'm working on that.

Note that this is a crash in V8 though, which can happen when running on a box with SELinux or grsecurity. Is any of these security packages running on your machine?

Comment by Imre Dávid Kosztka [X] [ 24/Aug/15 ]

2015-08-24T23:43:46.132+0200 I COMMAND  [conn9] going to kill op: op: 60086.0
2015-08-24T23:43:46.224+0200 E QUERY    [conn8] JavaScript execution terminated
2015-08-24T23:43:46.224+0200 F -        [conn8] Invalid access at address: 0
2015-08-24T23:43:46.233+0200 F -        [conn8] Got signal: 11 (Segmentation fault).
 
 0x114e90b 0x114e0c3 0x114e4a7 0x7f0197e1ed60 0x11e9e46 0x10a090d 0x109309a 0x10982cb 0x1098339 0x108aa4a 0x1091d7a 0x1092309 0xba7046 0xd01849 0xcd2471 0x93b221 0xa16978 0xa18dc6 0xa192eb 0xa1c7df 0xa4332c 0xa444e2 0xa45399 0xc8d8c7 0xb6a2d9 0x7d1779 0x10f4175 0x7f0197e154a4 0x7f01967c012d
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"400000","o":"D4E90B"},{"b":"400000","o":"D4E0C3"},{"b":"400000","o":"D4E4A7"},{"b":"7F0197E0E000","o":"10D60"},{"b":"400000","o":"DE9E46"},{"b":"400000","o":"CA090D"},{"b":"400000","o":"C9309A"},{"b":"400000","o":"C982CB"},{"b":"400000","o":"C98339"},{"b":"400000","o":"C8AA4A"},{"b":"400000","o":"C91D7A"},{"b":"400000","o":"C92309"},{"b":"400000","o":"7A7046"},{"b":"400000","o":"901849"},{"b":"400000","o":"8D2471"},{"b":"400000","o":"53B221"},{"b":"400000","o":"616978"},{"b":"400000","o":"618DC6"},{"b":"400000","o":"6192EB"},{"b":"400000","o":"61C7DF"},{"b":"400000","o":"64332C"},{"b":"400000","o":"6444E2"},{"b":"400000","o":"645399"},{"b":"400000","o":"88D8C7"},{"b":"400000","o":"76A2D9"},{"b":"400000","o":"3D1779"},{"b":"400000","o":"CF4175"},{"b":"7F0197E0E000","o":"74A4"},{"b":"7F01966D7000","o":"E912D"}],"processInfo":{ "mongodbVersion" : "3.0.5", "gitVersion" : "nogitversion", "uname" : { "sysname" : "Linux", "release" : "4.1.5-1-ARCH", "version" : "#1 SMP PREEMPT Tue Aug 11 15:41:14 CEST 2015", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E0C9C2A6CD0CB39F8BF061DEF5F4CFD4EF18598E" }, { "b" : "7FFF101E2000", "path" : "linux-vdso.so.1", "elfType" : 3, "buildId" : "FEE0A32CFF2A1A3074605E0A456A2D58D1B655E9" }, { "b" : "7F0198F83000", "path" : "/usr/lib/libsnappy.so.1", "elfType" : 3, "buildId" : "9D4BD954C9638C5AF8F33C9E757D5E37C9FA8ED2" }, { "b" : "7F0198D05000", "path" : "/usr/lib/libboost_program_options.so.1.58.0", "elfType" : 3, "buildId" : "7ED7CC3A2967448967E729DD716DE1E8DC1082A5" }, { "b" : "7F0198AED000", "path" : "/usr/lib/libboost_filesystem.so.1.58.0", "elfType" : 3, "buildId" : "69307A2E931F589C000ABB2535CB443E2E6A7FC3" }, { "b" : "7F01988C6000", "path" : "/usr/lib/libboost_thread.so.1.58.0", "elfType" : 3, "buildId" : "56D33D6B2101D6AFB786566C7AA105F443DDDEA0" }, { "b" : "7F01986C2000", "path" : "/usr/lib/libboost_system.so.1.58.0", "elfType" : 3, "buildId" : "0AC74F672BD854B0757E24D168DAB10747E1EEB3" }, { "b" : "7F0198452000", "path" : "/usr/lib/libpcre.so.1", "elfType" : 3, "buildId" : "735DBE44AAF7FE6AFC9A1FA1A714D973F7A0B4C2" }, { "b" : "7F0198248000", "path" : "/usr/lib/libpcrecpp.so.0", "elfType" : 3, "buildId" : "1AC3A716BAF09BC2191EA2B75EE6CE8CE36C3433" }, { "b" : "7F019802B000", "path" : "/usr/lib/libsasl2.so.3", "elfType" : 3, "buildId" : "77D3CE2669A200A63E578D8CF5381BB0162EC0B6" }, { "b" : "7F0197E0E000", "path" : "/usr/lib/libpthread.so.0", "elfType" : 3, "buildId" : "284BF58119A6255AFBA4568940CE655ECDFF1881" }, { "b" : "7F0197B94000", "path" : "/usr/lib/libssl.so.1.0.0", "elfType" : 3, "buildId" : "4E6FE13AD63FE3F0F3279F9BE077586E2BADF443" }, { "b" : "7F019771D000", "path" : "/usr/lib/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "E72E20F8FD3FB8B2C3EC7ADB5956E99D16AF15A4" }, { "b" : "7F0197515000", "path" : "/usr/lib/librt.so.1", "elfType" : 3, "buildId" : "6C39F2195A3E5D3A6A1FAEF570D0B83AF2184E3D" }, { "b" : "7F0197311000", "path" : "/usr/lib/libdl.so.2", "elfType" : 3, "buildId" : "4C55749EE719F7CE38F5078CE3197091D24EFEDE" }, { "b" : "7F0196F8F000", "path" : "/usr/lib/libstdc++.so.6", "elfType" : 3, "buildId" : "F9C96B2155AEC8ECE88F90C15953CEAA27644316" }, { "b" : "7F0196C91000", "path" : "/usr/lib/libm.so.6", "elfType" : 3, "buildId" : "1C20A8053268B03D81D85235D26B14F4D24DBC40" }, { "b" : "7F0196A7B000", "path" : "/usr/lib/libgcc_s.so.1", "elfType" : 3, "buildId" : "D1B747D5045FB4704C1B6A7723AACA20C0F1BD72" }, { "b" : "7F01966D7000", "path" : "/usr/lib/libc.so.6", "elfType" : 3, "buildId" : "18C9FD18D79DCE6408C752DC974B0B895286F861" }, { "b" : "7F0199189000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "1E92C999146627ACBCE03FAD01B4E344BB2D333A" }, { "b" : "7F01964C0000", "path" : "/usr/lib/libresolv.so.2", "elfType" : 3, "buildId" : "544EDFD9674594504CC408B41C1AAC2F3CF9ED63" }, { "b" : "7F01962AA000", "path" : "/usr/lib/libz.so.1", "elfType" : 3, "buildId" : "82A1A5B6D7F272E064155BB64576230AEFAFA7B8" } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x2B) [0x114e90b]
 mongod(+0xD4E0C3) [0x114e0c3]
 mongod(+0xD4E4A7) [0x114e4a7]
 libpthread.so.0(+0x10D60) [0x7f0197e1ed60]
 mongod(_ZN2v82V837AdjustAmountOfExternalAllocatedMemoryEl+0x16) [0x11e9e46]
 mongod(_ZN5boost6detail17sp_counted_impl_pIN5mongo10BSONHolderEE7disposeEv+0x3D) [0x10a090d]
 mongod(+0xC9309A) [0x109309a]
 mongod(_ZN5mongo7V8ScopeD1Ev+0x34B) [0x10982cb]
 mongod(_ZN5mongo7V8ScopeD0Ev+0x9) [0x1098339]
 mongod(+0xC8AA4A) [0x108aa4a]
 mongod(_ZN5mongo11PooledScopeD1Ev+0x81A) [0x1091d7a]
 mongod(_ZN5mongo11PooledScopeD0Ev+0x9) [0x1092309]
 mongod(_ZN5mongo20WhereMatchExpressionD0Ev+0x26) [0xba7046]
 mongod(_ZN5mongo18CollectionScanNodeD0Ev+0xE9) [0xd01849]
 mongod(_ZN5mongo12PlanExecutorD1Ev+0xB1) [0xcd2471]
 mongod(_ZN5boost10scoped_ptrIN5mongo12PlanExecutorEED1Ev+0x11) [0x93b221]
 mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x1598) [0xa16978]
 mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestERKNS_19WriteConcernOptionsEPSt6vectorIPNS_19BatchedUpsertDetailESaIS9_EEPS7_IPNS_16WriteErrorDetailESaISE_EE+0x236) [0xa18dc6]
 mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x38B) [0xa192eb]
 mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x22F) [0xa1c7df]
 mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C) [0xa4332c]
 mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xF22) [0xa444e2]
 mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x529) [0xa45399]
 mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_+0x677) [0xc8d8c7]
 mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xA69) [0xb6a2d9]
 mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xD9) [0x7d1779]
 mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x325) [0x10f4175]
 libpthread.so.0(+0x74A4) [0x7f0197e154a4]
 libc.so.6(clone+0x6D) [0x7f01967c012d]
-----  END BACKTRACE  -----

Generated at Thu Feb 08 03:53:09 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.