[SERVER-30064] Multiple nodes crashed with Invalid access at address: 0x78 | Got signal: 11 (Segmentation fault). Created: 08/Jul/17  Updated: 21/Feb/18  Resolved: 10/Jul/17

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: 3.4.5
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Marcus Ahle Assignee: Kelsey Schubert
Resolution: Duplicate Votes: 0
Labels: crash
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

3-Node Replicaset running in Amazon AWS on R3.2XLarge instances on Ubuntu Ubuntu 14.04.5 LTS


Issue Links:
Duplicate
duplicates SERVER-29850 Access violation due to a bug in inte... Closed
Operating System: ALL
Participants:

 Description   

We've had multiple non-primary nodes crash with the error:

Invalid access at address: 0x78
Got signal: 11 (Segmentation fault).

So far we've had 2 secondaries crash and 2 initial sync's crash with the above. I captured 2 of the errors:

Initial Sync crash:

2017-07-08T12:34:32.219+0000 I NETWORK  [conn38648] received client metadata from 10.0.8.200:34396 conn38648: { driver: { name: "PyMongo", version: "3.4.0" }, os: { type: "Linux", name: "Ubuntu 14.04 trusty", architecture: "x86_64", version: "3.13.0-121-generic" }, platform: "CPython 3.4.3.final.0", application: { name: "monitor: (pipeline.production.pazien, pid 10143)" } }
2017-07-08T12:34:32.223+0000 I NETWORK  [thread1] connection accepted from 10.0.8.200:34400 #38649 (222 connections now open)
2017-07-08T12:34:32.241+0000 I -        [conn38648] end connection 10.0.8.200:34396 (222 connections now open)
2017-07-08T12:34:32.243+0000 I NETWORK  [conn38649] received client metadata from 10.0.8.200:34400 conn38649: { driver: { name: "PyMongo", version: "3.4.0" }, os: { type: "Linux", name: "Ubuntu 14.04 trusty", architecture: "x86_64", version: "3.13.0-121-generic" }, platform: "CPython 3.4.3.final.0", application: { name: "monitor: (pipeline.production.pazien, pid 10143)" } }
2017-07-08T12:34:33.958+0000 I -        [repl writer worker 10]   pazien.processor.settlements collection clone progress: 238795326/1265553643 18% (documents copied)
2017-07-08T12:34:39.872+0000 I -        [conn38647] end connection 10.0.8.200:34388 (221 connections now open)
2017-07-08T12:34:39.872+0000 I -        [conn38649] end connection 10.0.8.200:34400 (221 connections now open)
2017-07-08T12:34:42.414+0000 I -        [conn38639] end connection 10.0.8.200:34014 (219 connections now open)
2017-07-08T12:34:42.414+0000 I -        [conn38637] end connection 10.0.8.200:34001 (218 connections now open)
2017-07-08T12:34:55.773+0000 F -        [InitialSyncInserters-pazien.processor.settlements0] Invalid access at address: 0x78
2017-07-08T12:34:55.828+0000 F -        [InitialSyncInserters-pazien.processor.settlements0] Got signal: 11 (Segmentation fault).
 
 0x7f0f0324ccb1 0x7f0f0324bec9 0x7f0f0324c536 0x7f0f00945330 0x7f0f009407b0 0x7f0f03b8102b 0x7f0f03b85395 0x7f0f03bd66aa 0x7f0f03bd12f3 0x7f0f03bd265a 0x7f0f03c2f42b 0x7f0f02f568a2 0x7f0f02f56bb0 0x7f0f02f4ac48 0x7f0f02f4b076 0x7f0f026bfa62 0x7f0f02bed483 0x7f0f02bed2f5 0x7f0f02d3f6c1 0x7f0f02d3f8c9 0x7f0f02d40a2f 0x7f0f031c670c 0x7f0f031c71bc 0x7f0f031c7ba6 0x7f0f03cc3130 0x7f0f0093d184 0x7f0f00669ffd
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"7F0F01CDB000","o":"1571CB1","s":"_ZN5mongo15printStackTraceERSo"},{"b":"7F0F01CDB000","o":"1570EC9"},{"b":"7F0F01CDB000","o":"1571536"},{"b":"7F0F00935000","o":"10330"},{"b":"7F0F00935000","o":"B7B0","s":"__pthread_mutex_unlock"},{"b":"7F0F01CDB000","o":"1EA602B"},{"b":"7F0F01CDB000","o":"1EAA395","s":"__wt_split_multi"},{"b":"7F0F01CDB000","o":"1EFB6AA","s":"__wt_evict"},{"b":"7F0F01CDB000","o":"1EF62F3"},{"b":"7F0F01CDB000","o":"1EF765A","s":"__wt_cache_eviction_worker"},{"b":"7F0F01CDB000","o":"1F5442B"},{"b":"7F0F01CDB000","o":"127B8A2","s":"_ZN5mongo22WiredTigerRecoveryUnit8_txnOpenEPNS_16OperationContextE"},{"b":"7F0F01CDB000","o":"127BBB0","s":"_ZN5mongo16WiredTigerCursorC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEmbPNS_16OperationContextE"},{"b":"7F0F01CDB000","o":"126FC48","s":"_ZN5mongo21WiredTigerRecordStore14_insertRecordsEPNS_16OperationContextEPNS_6RecordEm"},{"b":"7F0F01CDB000","o":"1270076","s":"_ZN5mongo21WiredTigerRecordStore12insertRecordEPNS_16OperationContextEPKcib"},{"b":"7F0F01CDB000","o":"9E4A62","s":"_ZN5mongo10Collection14insertDocumentEPNS_16OperationContextERKNS_7BSONObjERKSt6vectorIPNS_15MultiIndexBlockESaIS8_EEb"},{"b":"7F0F01CDB000","o":"F12483"},{"b":"7F0F01CDB000","o":"F122F5"},{"b":"7F0F01CDB000","o":"10646C1"},{"b":"7F0F01CDB000","o":"10648C9"},{"b":"7F0F01CDB000","o":"1065A2F","s":"_ZN5mongo4repl10TaskRunner9_runTasksEv"},{"b":"7F0F01CDB000","o":"14EB70C","s":"_ZN5mongo10ThreadPool10_doOneTaskEPSt11unique_lockISt5mutexE"},{"b":"7F0F01CDB000","o":"14EC1BC","s":"_ZN5mongo10ThreadPool13_consumeTasksEv"},{"b":"7F0F01CDB000","o":"14ECBA6","s":"_ZN5mongo10ThreadPool17_workerThreadBodyEPS0_RKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE"},{"b":"7F0F01CDB000","o":"1FE8130"},{"b":"7F0F00935000","o":"8184"},{"b":"7F0F0056C000","o":"FDFFD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.4.5", "gitVersion" : "520b8f3092c48d934f0cd78ab5f40fe594f96863", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.13.0-121-generic", "version" : "#170-Ubuntu SMP Wed Jun 14 09:04:33 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "b" : "7F0F01CDB000", "elfType" : 3, "buildId" : "4CA0F472716BD03B90F2DCC8460A6D07F8994AD4" }, { "b" : "7FFD7D4F3000", "elfType" : 3, "buildId" : "1065C8F862FD32864124951EF77EC6AB63637C5A" }, { "b" : "7F0F01857000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "48A664AE6B0B4918A3EB0156C6364C4F084232FD" }, { "b" : "7F0F0147B000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "6B8997EA892A7FF37AC8CAA8F239D595251889BB" }, { "b" : "7F0F01273000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "AC72654C6338205F30190061C0D781CB0039B793" }, { "b" : "7F0F0106F000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "EED41ABB999C74882F001C53979CC820ED15BA82" }, { "b" : "7F0F00D69000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "8F0318B9CC6FD523C2587A15C5447ABBB8CD813D" }, { "b" : "7F0F00B53000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "36311B4457710AE5578C4BF00791DED7359DBB92" }, { "b" : "7F0F00935000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "F48E96A1F4A549776CA4167095AD7527720D4B0E" }, { "b" : "7F0F0056C000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "3217CA3A53A930C7BB1E5C83789D09B30B0F3B39" }, { "b" : "7F0F01AB6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37AFDBB933B8409476E845DF5FB11BC77CBCEEE6" } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x7f0f0324ccb1]
 mongod(+0x1570EC9) [0x7f0f0324bec9]
 mongod(+0x1571536) [0x7f0f0324c536]
 libpthread.so.0(+0x10330) [0x7f0f00945330]
 libpthread.so.0(__pthread_mutex_unlock+0x0) [0x7f0f009407b0]
 mongod(+0x1EA602B) [0x7f0f03b8102b]
 mongod(__wt_split_multi+0xA5) [0x7f0f03b85395]
 mongod(__wt_evict+0x92A) [0x7f0f03bd66aa]
 mongod(+0x1EF62F3) [0x7f0f03bd12f3]
 mongod(__wt_cache_eviction_worker+0x47A) [0x7f0f03bd265a]
 mongod(+0x1F5442B) [0x7f0f03c2f42b]
 mongod(_ZN5mongo22WiredTigerRecoveryUnit8_txnOpenEPNS_16OperationContextE+0x52) [0x7f0f02f568a2]
 mongod(_ZN5mongo16WiredTigerCursorC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEmbPNS_16OperationContextE+0x90) [0x7f0f02f56bb0]
 mongod(_ZN5mongo21WiredTigerRecordStore14_insertRecordsEPNS_16OperationContextEPNS_6RecordEm+0xB8) [0x7f0f02f4ac48]
 mongod(_ZN5mongo21WiredTigerRecordStore12insertRecordEPNS_16OperationContextEPKcib+0x46) [0x7f0f02f4b076]
 mongod(_ZN5mongo10Collection14insertDocumentEPNS_16OperationContextERKNS_7BSONObjERKSt6vectorIPNS_15MultiIndexBlockESaIS8_EEb+0x102) [0x7f0f026bfa62]
 mongod(+0xF12483) [0x7f0f02bed483]
 mongod(+0xF122F5) [0x7f0f02bed2f5]
 mongod(+0x10646C1) [0x7f0f02d3f6c1]
 mongod(+0x10648C9) [0x7f0f02d3f8c9]
 mongod(_ZN5mongo4repl10TaskRunner9_runTasksEv+0xAF) [0x7f0f02d40a2f]
 mongod(_ZN5mongo10ThreadPool10_doOneTaskEPSt11unique_lockISt5mutexE+0x14C) [0x7f0f031c670c]
 mongod(_ZN5mongo10ThreadPool13_consumeTasksEv+0xBC) [0x7f0f031c71bc]
 mongod(_ZN5mongo10ThreadPool17_workerThreadBodyEPS0_RKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x96) [0x7f0f031c7ba6]
 mongod(+0x1FE8130) [0x7f0f03cc3130]
 libpthread.so.0(+0x8184) [0x7f0f0093d184]
 libc.so.6(clone+0x6D) [0x7f0f00669ffd]
-----  END BACKTRACE  -----
 
 
Secondary crash:
2017-06-23T20:10:42.964+0000 F -        [thread2] Invalid access at address: 0x78
2017-06-23T20:10:43.011+0000 F -        [thread2] Got signal: 11 (Segmentation fault).
 
 0x7fe640585cb1 0x7fe640584ec9 0x7fe640585536 0x7fe63dc7e330 0x7fe63dc797b0 0x7fe640eba02b 0x7fe640ebe395 0x7fe640f0f6aa 0x7fe640f0a2f3 0x7fe640f0a687 0x7fe640f0c033 0x7fe640f75f36 0x7fe63dc76184 0x7fe63d9a2ffd
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"7FE63F014000","o":"1571CB1","s":"_ZN5mongo15printStackTraceERSo"},{"b":"7FE63F014000","o":"1570EC9"},{"b":"7FE63F014000","o":"1571536"},{"b":"7FE63DC6E000","o":"10330"},{"b":"7FE63DC6E000","o":"B7B0","s":"__pthread_mutex_unlock"},{"b":"7FE63F014000","o":"1EA602B"},{"b":"7FE63F014000","o":"1EAA395","s":"__wt_split_multi"},{"b":"7FE63F014000","o":"1EFB6AA","s":"__wt_evict"},{"b":"7FE63F014000","o":"1EF62F3"},{"b":"7FE63F014000","o":"1EF6687"},{"b":"7FE63F014000","o":"1EF8033","s":"__wt_evict_thread_run"},{"b":"7FE63F014000","o":"1F61F36","s":"__wt_thread_run"},{"b":"7FE63DC6E000","o":"8184"},{"b":"7FE63D8A5000","o":"FDFFD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.4.5", "gitVersion" : "520b8f3092c48d934f0cd78ab5f40fe594f96863", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.13.0-121-generic", "version" : "#170-Ubuntu SMP Wed Jun 14 09:04:33 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "b" : "7FE63F014000", "elfType" : 3, "buildId" : "4CA0F472716BD03B90F2DCC8460A6D07F8994AD4" }, { "b" : "7FFE5D918000", "elfType" : 3, "buildId" : "1065C8F862FD32864124951EF77EC6AB63637C5A" }, { "b" : "7FE63EB90000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "48A664AE6B0B4918A3EB0156C6364C4F084232FD" }, { "b" : "7FE63E7B4000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "6B8997EA892A7FF37AC8CAA8F239D595251889BB" }, { "b" : "7FE63E5AC000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "AC72654C6338205F30190061C0D781CB0039B793" }, { "b" : "7FE63E3A8000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "EED41ABB999C74882F001C53979CC820ED15BA82" }, { "b" : "7FE63E0A2000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "8F0318B9CC6FD523C2587A15C5447ABBB8CD813D" }, { "b" : "7FE63DE8C000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "36311B4457710AE5578C4BF00791DED7359DBB92" }, { "b" : "7FE63DC6E000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "F48E96A1F4A549776CA4167095AD7527720D4B0E" }, { "b" : "7FE63D8A5000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "3217CA3A53A930C7BB1E5C83789D09B30B0F3B39" }, { "b" : "7FE63EDEF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37AFDBB933B8409476E845DF5FB11BC77CBCEEE6" } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x7fe640585cb1]
 mongod(+0x1570EC9) [0x7fe640584ec9]
 mongod(+0x1571536) [0x7fe640585536]
 libpthread.so.0(+0x10330) [0x7fe63dc7e330]
 libpthread.so.0(__pthread_mutex_unlock+0x0) [0x7fe63dc797b0]
 mongod(+0x1EA602B) [0x7fe640eba02b]
 mongod(__wt_split_multi+0xA5) [0x7fe640ebe395]
 mongod(__wt_evict+0x92A) [0x7fe640f0f6aa]
 mongod(+0x1EF62F3) [0x7fe640f0a2f3]
 mongod(+0x1EF6687) [0x7fe640f0a687]
 mongod(__wt_evict_thread_run+0xD3) [0x7fe640f0c033]
 mongod(__wt_thread_run+0x16) [0x7fe640f75f36]
 libpthread.so.0(+0x8184) [0x7fe63dc76184]
 libc.so.6(clone+0x6D) [0x7fe63d9a2ffd]
-----  END BACKTRACE  -----

At first I thought it may have been a bad volume but after multiple new volumes and this happening 4 times, I don't believe it to be hardware.



 Comments   
Comment by Kelsey Schubert [ 21/Feb/18 ]

Hi Kiran_Naikwade,

As Eric mentioned in response to your comment on SERVER-29850, this stacktrace matches SERVER-32677. Generally, it's preferable to open a new ticket so we can investigate whether it's a duplicate rather commenting on multiple tickets.

Thanks,
Kelsey

Comment by Kiran Naikwade [X] [ 21/Feb/18 ]

Hi,
I am facing the same issue while configuring shard.
Mongo version: 3.6.2

"CentOS Linux release 7.4.1708 (Core) ", architecture: "x86_64", version: "Kernel 3.10.0-693.17.1.el7.x86_64" } }
2018-02-21T18:34:27.926+0900 F -        [thread13] Invalid access at address: 0x18
2018-02-21T18:34:27.952+0900 F -        [thread13] Got signal: 11 (Segmentation fault).
 
 0x565116632061 0x565116631279 0x5651166318e6 0x7f0cb1e6a5e0 0x7f0cb1e64c30 0x565115e03836 0x565115e085c1 0x565115494bfe 0x565115494f20 0x565115f074ca 0x565115f08978 0x56511547bf42 0x565116144a7a 0x56511614543c 0x565116145814 0x5651161c7719 0x5651161c7961 0x56511547ae4d 0x56511673fa40 0x7f0cb1e62e25 0x7f0cb1b9034d
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"565114435000","o":"21FD061","s":"_ZN5mongo15printStackTraceERSo"},{"b":"565114435000","o":"21FC279"},{"b":"565114435000","o":"21FC8E6"},{"b":"7F0CB1E5B000","o":"F5E0"},{"b":"7F0CB1E5B000","o":"9C30","s":"pthread_mutex_lock"},{"b":"565114435000","o":"19CE836","s":"_ZN5mongo12CatalogCache27invalidateShardedCollectionERKNS_15NamespaceStringE"},{"b":"565114435000","o":"19D35C1","s":"_ZN5mongo12CatalogCache42getShardedCollectionRoutingInfoWithRefreshEPNS_16OperationContextERKNS_15NamespaceStringE"},{"b":"565114435000","o":"105FBFE","s":"_ZN5mongo25SessionsCollectionSharded32_checkCacheForSessionsCollectionEPNS_16OperationContextE"},{"b":"565114435000","o":"105FF20","s":"_ZN5mongo25SessionsCollectionSharded23setupSessionsCollectionEPNS_16OperationContextE"},{"b":"565114435000","o":"1AD24CA","s":"_ZN5mongo23LogicalSessionCacheImpl8_refreshEPNS_6ClientE"},{"b":"565114435000","o":"1AD3978","s":"_ZN5mongo23LogicalSessionCacheImpl16_periodicRefreshEPNS_6ClientE"},{"b":"565114435000","o":"1046F42"},{"b":"565114435000","o":"1D0FA7A","s":"_ZN4asio6detail14strand_service8dispatchINS0_7binder1ISt8functionIFvSt10error_codeEES5_EEEEvRPNS1_11strand_implERT_"},{"b":"565114435000","o":"1D1043C","s":"_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder1INS0_15wrapped_handlerINS_10io_context6strandESt8functionIFvSt10error_codeEENS0_26is_continuation_if_runningEEES9_EESB_EEEEvRPNS1_11strand_implERT_"},{"b":"565114435000","o":"1D10814","s":"_ZN4asio6detail12wait_handlerINS0_15wrapped_handlerINS_10io_context6strandESt8functionIFvSt10error_codeEENS0_26is_continuation_if_runningEEEE11do_completeEPvPNS0_19scheduler_operationERKS6_m"},{"b":"565114435000","o":"1D92719","s":"_ZN4asio6detail9scheduler10do_run_oneERNS0_27conditionally_enabled_mutex11scoped_lockERNS0_21scheduler_thread_infoERKSt10error_code"},{"b":"565114435000","o":"1D92961","s":"_ZN4asio6detail9scheduler3runERSt10error_code"},{"b":"565114435000","o":"1045E4D"},{"b":"565114435000","o":"230AA40"},{"b":"7F0CB1E5B000","o":"7E25"},{"b":"7F0CB1A98000","o":"F834D","s":"clone"}],"processInfo":{ {color:red}*"mongodbVersion" : "3.6.2"*{color}, "gitVersion" : "489d177dbd0f0420a8ca04d39fd78d0a2c539420", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.0-693.17.1.el7.x86_64", "version" : "#1 SMP Thu Jan 25 20:13:58 UTC 2018", "machine" : "x86_64" }, "somap" : [ { "b" : "565114435000", "elfType" : 3, "buildId" : "D02F86992A859CC55616E5547729F7F8C6D7F890" }, { "b" : "7FFD678CA000", "elfType" : 3, "buildId" : "47E1DE363A68C3E5970550C87DAFA3CCF9713953" }, { "b" : "7F0CB306E000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "FF4E72F4E574E143330FB3C66DB51613B0EC65EA" }, { "b" : "7F0CB2DFC000", "path" : "/lib64/libssl.so.10", "elfType" : 3, "buildId" : "ED0AC7DEB91A242C194B3DEF27A215F41CE43116" }, { "b" : "7F0CB299B000", "path" : "/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "BC0AE9CA0705BEC1F0C0375AAD839843BB219CB1" }, { "b" : "7F0CB2793000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "6D322588B36D2617C03C0F3B93677E62FCFFDA81" }, { "b" : "7F0CB258F000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "1E42EBFB272D37B726F457D6FE3C33D2B094BB69" }, { "b" : "7F0CB228D000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "808BD35686C193F218A5AAAC6194C49214CFF379" }, { "b" : "7F0CB2077000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "3E85E6D20D2CE9CDAD535084BEA56620BAAD687C" }, { "b" : "7F0CB1E5B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "A48D21B2578A8381FBD8857802EAA660504248DC" }, { "b" : "7F0CB1A98000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "95FF02A4BEBABC573C7827A66D447F7BABDDAA44" }, { "b" : "7F0CB3288000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "22FA66DA7D14C88BF36C69454A357E5F1DEFAE4E" }, { "b" : "7F0CB184B000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "DA322D74F55A0C4293085371A8D0E94B5962F5E7" }, { "b" : "7F0CB1563000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "B69E63024D408E400401EEA6815317BDA38FB7C2" }, { "b" : "7F0CB135F000", "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "A3832734347DCA522438308C9F08F45524C65C9B" }, { "b" : "7F0CB112C000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "A48639BF901DB554479BFAD114CB354CF63D7D6E" }, { "b" : "7F0CB0F16000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "EA8E45DC8E395CC5E26890470112D97A1F1E0B65" }, { "b" : "7F0CB0D08000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "6FDF5B013FD2739D304CFB9D723DCBC149EE03C9" }, { "b" : "7F0CB0B04000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "2E01D5AC08C1280D013AAB96B292AC58BC30A263" }, { "b" : "7F0CB08DD000", "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "A88379F56A51950A33198890D37F5F8AEE71F8B4" }, { "b" : "7F0CB067B000", "path" : "/lib64/libpcre.so.1", "elfType" : 3, "buildId" : "9CA3D11F018BEEB719CDB34BE800BF1641350D0A" } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x565116632061]
 mongod(+0x21FC279) [0x565116631279]
 mongod(+0x21FC8E6) [0x5651166318e6]
 libpthread.so.0(+0xF5E0) [0x7f0cb1e6a5e0]
 libpthread.so.0(pthread_mutex_lock+0x0) [0x7f0cb1e64c30]
 mongod(_ZN5mongo12CatalogCache27invalidateShardedCollectionERKNS_15NamespaceStringE+0x46) [0x565115e03836]
 mongod(_ZN5mongo12CatalogCache42getShardedCollectionRoutingInfoWithRefreshEPNS_16OperationContextERKNS_15NamespaceStringE+0x41) [0x565115e085c1]
 mongod(_ZN5mongo25SessionsCollectionSharded32_checkCacheForSessionsCollectionEPNS_16OperationContextE+0x10E) [0x565115494bfe]
 mongod(_ZN5mongo25SessionsCollectionSharded23setupSessionsCollectionEPNS_16OperationContextE+0x20) [0x565115494f20]
 mongod(_ZN5mongo23LogicalSessionCacheImpl8_refreshEPNS_6ClientE+0x12A) [0x565115f074ca]
 mongod(_ZN5mongo23LogicalSessionCacheImpl16_periodicRefreshEPNS_6ClientE+0x28) [0x565115f08978]
 mongod(+0x1046F42) [0x56511547bf42]
 mongod(_ZN4asio6detail14strand_service8dispatchINS0_7binder1ISt8functionIFvSt10error_codeEES5_EEEEvRPNS1_11strand_implERT_+0x7A) [0x565116144a7a]
 mongod(_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder1INS0_15wrapped_handlerINS_10io_context6strandESt8functionIFvSt10error_codeEENS0_26is_continuation_if_runningEEES9_EESB_EEEEvRPNS1_11strand_implERT_+0x3AC) [0x56511614543c]
 mongod(_ZN4asio6detail12wait_handlerINS0_15wrapped_handlerINS_10io_context6strandESt8functionIFvSt10error_codeEENS0_26is_continuation_if_runningEEEE11do_completeEPvPNS0_19scheduler_operationERKS6_m+0x164) [0x565116145814]
 mongod(_ZN4asio6detail9scheduler10do_run_oneERNS0_27conditionally_enabled_mutex11scoped_lockERNS0_21scheduler_thread_infoERKSt10error_code+0x389) [0x5651161c7719]
 mongod(_ZN4asio6detail9scheduler3runERSt10error_code+0xD1) [0x5651161c7961]
 mongod(+0x1045E4D) [0x56511547ae4d]
 mongod(+0x230AA40) [0x56511673fa40]
 libpthread.so.0(+0x7E25) [0x7f0cb1e62e25]
 libc.so.6(clone+0x6D) [0x7f0cb1b9034d]
-----  END BACKTRACE  -----

Comment by Kelsey Schubert [ 10/Jul/17 ]

Hi marcusahle,

Yes, that's correct. This issue should be resolved by SERVER-29850. If you encounter this issue again after upgrading, please let us know and we will continue to investigate.

Thank you,
Thomas

Comment by Marcus Ahle [ 08/Jul/17 ]

I just noticed this is supposed to be fixed in 3.4.6. We'll upgrade and give it a try.

Generated at Thu Feb 08 04:22:34 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.