[SERVER-28788] Mongos crashes with an invariant error Created: 13/Apr/17  Updated: 31/May/17  Resolved: 14/Apr/17

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: 3.4.2
Fix Version/s: None

Type: Bug Priority: Critical - P2
Reporter: Edik Mkoyan Assignee: Kelsey Schubert
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
duplicates SERVER-27863 Reschedule early alarms in NetworkInt... Closed
Operating System: ALL
Participants:

 Description   

Mongos crashes with this in log

Invariant failure now() >= when src/mongo/executor/thread_pool_task_executor.cpp 295
2017-04-13T05:04:56.844+0400 I -        [ReplicaSetMonitor-TaskExecutor-0] 
 
***aborting after invariant() failure
 
 
2017-04-13T05:04:56.880+0400 F -        [ReplicaSetMonitor-TaskExecutor-0] Got signal: 6 (Aborted).
 
 0x7f6839fc76e1 0x7f6839fc67d9 0x7f6839fc6cbd 0x7f683808d330 0x7f6837ceec37 0x7f6837cf2028 0x7f68397ff7be 0x7f6839d1b8b8 0x7f6839cf2b15 0x7f683a0a5294 0x7f683a0a5491 0x7f6839cf1c1f 0x7f683a3a5960 0x7f6838085184 0x7f6837db237d
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"7F6839423000","o":"BA46E1","s":"_ZN5mongo15printStackTraceERSo"},{"b":"7F6839423000","o":"BA37D9"},{"b":"7F6839423000","o":"BA3CBD"},{"b":"7F683807D000","o":"10330"},{"b":"7F6837CB8000","o":"36C37","s":"gsignal"},{"b":"7F6837CB8000","o":"3A028","s":"abort"},{"b":"7F6839423000","o":"3DC7BE","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"7F6839423000","o":"8F88B8"},{"b":"7F6839423000","o":"8CFB15"},{"b":"7F6839423000","o":"C82294","s":"_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code"},{"b":"7F6839423000","o":"C82491","s":"_ZN4asio6detail9scheduler3runERSt10error_code"},{"b":"7F6839423000","o":"8CEC1F"},{"b":"7F6839423000","o":"F82960"},{"b":"7F683807D000","o":"8184"},{"b":"7F6837CB8000","o":"FA37D","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.4.2", "gitVersion" : "3f76e40c105fc223b3e5aac3e20dcd026b83b38b", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.19.0-33-generic", "version" : "#38~14.04.1-Ubuntu SMP Fri Nov 6 18:17:28 UTC 2015", "machine" : "x86_64" }, "somap" : [ { "b" : "7F6839423000", "elfType" : 3, "buildId" : "149E88146384D65E439E13324AF97C149CF35650" }, { "b" : "7FFC3C3A8000", "elfType" : 3, "buildId" : "3AA714083E1D7D719D6C5A7B1A4A8D3649727CB8" }, { "b" : "7F6838F9F000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "48A664AE6B0B4918A3EB0156C6364C4F084232FD" }, { "b" : "7F6838BC3000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "6B8997EA892A7FF37AC8CAA8F239D595251889BB" }, { "b" : "7F68389BB000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "E2A6DD5048A0A051FD61043BDB69D8CC68192AB7" }, { "b" : "7F68387B7000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "DA9B8C234D0FE9FD8CAAC8970A7EC1B6C8F6623F" }, { "b" : "7F68384B1000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "D144258E614900B255A31F3FD2283A878670D5BC" }, { "b" : "7F683829B000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "36311B4457710AE5578C4BF00791DED7359DBB92" }, { "b" : "7F683807D000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "31E9F21AE8C10396171F1E13DA15780986FA696C" }, { "b" : "7F6837CB8000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "CF699A15CAAE64F50311FC4655B86DC39A479789" }, { "b" : "7F68391FE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "D0F537904076D73F29E4A37341F8A449E2EF6CD0" }, { "b" : "7F6837AAD000", "path" : "/lib/x86_64-linux-gnu/libnss_files.so.2", "elfType" : 3, "buildId" : "A0BDDA36D5AD1390D4DF158D7AD7CC866E534C28" }, { "b" : "7F68378A7000", "path" : "/lib/x86_64-linux-gnu/libnss_dns.so.2", "elfType" : 3, "buildId" : "A5721A2FACA0CB423F6C851DF8B7A96C52E94691" }, { "b" : "7F683768C000", "path" : "/lib/x86_64-linux-gnu/libresolv.so.2", "elfType" : 3, "buildId" : "FE705AA7E3872B43EA9E99FAF1897F7F85FC0AC9" } ] }}
 mongos(_ZN5mongo15printStackTraceERSo+0x41) [0x7f6839fc76e1]
 mongos(+0xBA37D9) [0x7f6839fc67d9]
 mongos(+0xBA3CBD) [0x7f6839fc6cbd]
 libpthread.so.0(+0x10330) [0x7f683808d330]
 libc.so.6(gsignal+0x37) [0x7f6837ceec37]
 libc.so.6(abort+0x148) [0x7f6837cf2028]
 mongos(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0x0) [0x7f68397ff7be]
 mongos(+0x8F88B8) [0x7f6839d1b8b8]
 mongos(+0x8CFB15) [0x7f6839cf2b15]
 mongos(_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code+0x324) [0x7f683a0a5294]
 mongos(_ZN4asio6detail9scheduler3runERSt10error_code+0xD1) [0x7f683a0a5491]
 mongos(+0x8CEC1F) [0x7f6839cf1c1f]
 mongos(+0xF82960) [0x7f683a3a5960]
 libpthread.so.0(+0x8184) [0x7f6838085184]
 libc.so.6(clone+0x6D) [0x7f6837db237d]
-----  END BACKTRACE  -----



 Comments   
Comment by Edik Mkoyan [ 14/Apr/17 ]

The version of my mongos is 3.4.2, I didn't yet upgraded my cluster. Thanks!!!

Comment by Kelsey Schubert [ 13/Apr/17 ]

Hi edikmkoyan,

Thanks for the report. After examining the log, it appears that affected version is 3.4.2. Would you please confirm the version of the mongos?

We expect that this issue is resolved in MongoDB 3.4.3 under SERVER-27863.

Kind regards,
Thomas

Generated at Thu Feb 08 04:19:03 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.