[SERVER-82688] mongod crash, bug fix when connections > wiredtiger's session_max Created: 02/Nov/23 Updated: 06/Feb/24 |
|
| Status: | Open |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | y yz | Assignee: | Backlog - Storage Execution Team |
| Resolution: | Unresolved | Votes: | 0 |
| Labels: | pull-request, storex-ranked | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Assigned Teams: |
Storage Execution
|
| Operating System: | ALL |
| Participants: |
| Description |
|
if user's max connections is greater than wiredtiger's session_max, it will crush. wiredtiger's session_max must great than user's connection. |
| Comments |
| Comment by Edwin Zhou [ 09/Nov/23 ] |
|
Hi 1147952115@qq.com, thank you for your pull request. I will pass this over to the Storage Execution team for consideration. |
| Comment by y yz [ 02/Nov/23 ] |
| Comment by y yz [ 02/Nov/23 ] |
|
2023-10-30T03:53:07.009+0000 I NETWORK [conn57885] received client metadata from xx.xx.16.8:47394 conn57885: { driver: { name: "NetworkInterfaceTL", version: "4.0.3" }, os: { type: "Linux", name: "Ubuntu", architecture: "x86_64", version: "16.04" } } , os: { type: "Linux", name: "Ubuntu", architecture: "x86_64", version: "16.04" } } , os: { type: "Linux", name: "Ubuntu", architecture: "x86_64", version: "16.04" } } ***aborting after invariant() failure 2023-10-30T03:53:07.041+0000 F - [conn57886] ***aborting after invariant() failure 2023-10-30T03:53:07.042+0000 E STORAGE [conn57120] WiredTiger error (-31802) [1698637987:42823][1:0x7f3f3e9f0700], WT_CONNECTION.open_session: __open_session, 2161: out of sessions, configured for 20030 (including internal sessions): WT_ERROR: non-specific WiredTiger error Raw: [1698637987:42823][1:0x7f3f3e9f0700], WT_CONNECTION.open_session: __open_session, 2161: out of sessions, configured for 20030 (including internal sessions): WT_ERROR: non-specific WiredTiger error ***aborting after invariant() failure 2023-10-30T03:53:07.052+0000 E STORAGE [conn57876] WiredTiger error (-31802) [1698637987:52901][1:0x7f3f0f3fd700], WT_CONNECTION.open_session: __open_session, 2161: out of sessions, configured for 20030 (including internal sessions): WT_ERROR: non-specific WiredTiger error Raw: [1698637987:52901][1:0x7f3f0f3fd700], WT_CONNECTION.open_session: __open_session, 2161: out of sessions, configured for 20030 (including internal sessions): WT_ERROR: non-specific WiredTiger error ***aborting after invariant() failure 2023-10-30T03:53:07.056+0000 I NETWORK [listener] connection accepted from 172.16.16.8:47402 #57888 (21018 connections now open) ,{"b":"560BCDD8E000","o":"23CD289"},{"b":"560BCDD8E000","o":"23CD76D"},{"b":"7F445DAD4000","o":"11390"},{"b":"7F445D70A000","o":"35428","s":"gsignal"},{"b":"7F445D70A000","o":"3702A","s":"abort"},{"b":"560BCDD8E000","o":"A0C4C8","s":"ZN5mongo24invariantOKFailedWithMsgEPKcRKNS_6StatusERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEES1_j"},{"b":"560BCDD8E000","o":"AF77AB","s":"_ZN5mongo17WiredTigerSessionC2EP15wt_connectionPNS_22WiredTigerSessionCacheEmm"},{"b":"560BCDD8E000","o":"AF87B8","s":"_ZN5mongo22WiredTigerSessionCache10getSessionEv"},{"b":"560BCDD8E000","o":"AF37AD"},{"b":"560BCDD8E000","o":"AF6345","s":"_ZN5mongo22WiredTigerRecoveryUnit8_txnOpenEv"},{"b":"560BCDD8E000","o":"AF708D","s":"_ZN5mongo16WiredTigerCursorC1ERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEEmbPNS_16OperationContextE"},{"b":"560BCDD8E000","o":"AC9B65","s":"_ZNK5mongo21WiredTigerIndexUnique9newCursorEPNS_16OperationContextEb"},{"b":"560BCDD8E000","o":"1AF5C4E","s":"_ZNK5mongo17IndexAccessMethod10findSingleEPNS_16OperationContextERKNS_7BSONObjE"},{"b":"560BCDD8E000","o":"12AE7AA","s":"_ZN5mongo11IDHackStage6doWorkEPm"},{"b":"560BCDD8E000","o":"12C34BB","s":"_ZN5mongo9PlanStage4workEPm"},{"b":"560BCDD8E000","o":"1313F6D","s":"_ZN5mongo12PlanExecutor11getNextImplEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE"},{"b":"560BCDD8E000","o":"13148FB","s":"_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE"},{"b":"560BCDD8E000","o":"10A1CB5"},{"b":"560BCDD8E000","o":"1E3DAE9","s":"_ZN5mongo12BasicCommand10Invocation3runEPNS_16OperationContextEPNS_19CommandReplyBuilderE"},{"b":"560BCDD8E000","o":"AB657B"},{"b":"560BCDD8E000","o":"AB8957"},{"b":"560BCDD8E000","o":"ABAD29"},{"b":"560BCDD8E000","o":"ABBC61","s":"_ZN5mongo23ServiceEntryPointCommon13handleRequestEPNS_16OperationContextERKNS_7MessageERKNS0_5HooksE"},{"b":"560BCDD8E000","o":"AA923A","s":"_ZN5mongo23ServiceEntryPointMongod13handleRequestEPNS_16OperationContextERKNS_7MessageE"},{"b":"560BCDD8E000","o":"1AEFBED"},{"b":"560BCDD8E000","o":"1AF0274","s":"_ZN5mongo14DBDirectClient4callERNS_7MessageES2_bPNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEE"},{"b":"560BCDD8E000","o":"1D9AF16","s":"_ZN5mongo14DBClientCursor4initEv"},{"b":"560BCDD8E000","o":"1D8A3D6","s":"_ZN5mongo12DBClientBase5queryERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEENS_5QueryEiiPKNS_7BSONObjEii"},{"b":"560BCDD8E000","o":"1AF0370","s":"_ZN5mongo14DBDirectClient5queryERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEENS_5QueryEiiPKNS_7BSONObjEii"},{"b":"560BCDD8E000","o":"1D937D6","s":"_ZN5mongo12DBClientBase5findNERSt6vectorINS_7BSONObjESaIS2_EERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEENS_5QueryEiiPKS2_i"},{"b":"560BCDD8E000","o":"1D93D9F","s":"_ZN5mongo12DBClientBase7findOneERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKNS_5QueryEPKNS_7BSONObjEi"},{"b":"560BCDD8E000","o":"1935D30","s":"_ZN5mongo7Session26refreshFromStorageIfNeededEPNS_16OperationContextE"},{"b":"560BCDD8E000","o":"193BD07","s":"ZN5mongo23OperationContextSessionC2EPNS_16OperationContextEbN5boost8optionalIbEES5_NS_10StringDataES6{_}"},{"b":"560BCDD8E000","o":"AB7089"},{"b":"560BCDD8E000","o":"ABAD29"},{"b":"560BCDD8E000","o":"ABBC61","s":"_ZN5mongo23ServiceEntryPointCommon13handleRequestEPNS_16OperationContextERKNS_7MessageERKNS0_5HooksE"},{"b":"560BCDD8E000","o":"AA923A","s":"_ZN5mongo23ServiceEntryPointMongod13handleRequestEPNS_16OperationContextERKNS_7MessageE"},{"b":"560BCDD8E000","o":"AB3FAA","s":"_ZN5mongo19ServiceStateMachine15_processMessageENS0_11ThreadGuardE"},{"b":"560BCDD8E000","o":"AAEC77","s":"_ZN5mongo19ServiceStateMachine15_runNextInGuardENS0_11ThreadGuardE"},{"b":"560BCDD8E000","o":"AB2481"},{"b":"560BCDD8E000","o":"1C6CB62","s":"_ZN5mongo9transport26ServiceExecutorSynchronous8scheduleESt8functionIFvvEENS0_15ServiceExecutor13ScheduleFlagsENS0_23ServiceExecutorTaskNameE"},{"b":"560BCDD8E000","o":"AACE8F","s":"_ZN5mongo19ServiceStateMachine22_scheduleNextWithGuardENS0_11ThreadGuardENS_9transport15ServiceExecutor13ScheduleFlagsENS2_23ServiceExecutorTaskNameENS0_9OwnershipE"},{"b":"560BCDD8E000","o":"AB0025","s":"_ZN5mongo19ServiceStateMachine15_sourceCallbackENS_6StatusE"},{"b":"560BCDD8E000","o":"AAE3B7","s":"_ZN5mongo19ServiceStateMachine14_sourceMessageENS0_11ThreadGuardE"},{"b":"560BCDD8E000","o":"AAECFD","s":"_ZN5mongo19ServiceStateMachine15_runNextInGuardENS0_11ThreadGuardE"},{"b":"560BCDD8E000","o":"AB2481"},{"b":"560BCDD8E000","o":"1C6D0C5"},{"b":"560BCDD8E000","o":"2327634"},{"b":"7F445DAD4000","o":"76BA"},{"b":"7F445D70A000","o":"10741D","s":"clone"}],"processInfo":{ "mongodbVersion" : "4.0.3", "gitVersion" : "7ea530946fa7880364d88c8d8b6026bbc9ffa48c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "5.4.119-19-0008", "version" : "[#1|https://github.com/mongodb/mongo/pull/1] SMP Mon Sep 13 14:54:39 CST 2021", "machine" : "x86_64" }, "somap" : [ { "b" : "560BCDD8E000", "elfType" : 3, "buildId" : "5CEC4F75328106C4E3A4535157518B166B4D38FD" }, { "b" : "7FFDC1E14000", "elfType" : 3, "buildId" : "57CC276D5EF9C861BC97A133F873E93734397F5B" }, { "b" : "7F445EEE4000", "path" : "/usr/lib/x86_64-linux-gnu/libcurl.so.4", "elfType" : 3, "buildId" : "5D192460BE804CC9B9807E6D49834431CBF20E9A" }, { "b" : "7F445ECC9000", "path" : "/lib/x86_64-linux-gnu/libresolv.so.2", "elfType" : 3, "buildId" : "6EF73266978476EF9F2FD2CF31E57F4597CB74F8" }, { "b" : "7F445E885000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "250E875F74377DFC74DE48BF80CCB237BB4EFF1D" }, { "b" : "7F445E61C000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "513282AC7EB386E2C0133FD9E1B6B8A0F38B047D" }, { "b" : "7F445E418000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "8CC8D0D119B142D839800BFF71FB71E73AEA7BD4" }, { "b" : "7F445E210000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "89C34D7A182387D76D5CDA1F7718F5D58824DFB3" }, { "b" : "7F445DF07000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "DFB85DE42DAFFD09640C8FE377D572DE3E168920" }, { "b" : "7F445DCF1000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "68220AE2C65D65C1B6AAA12FA6765A6EC2F5F434" }, { "b" : "7F445DAD4000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "CE17E023542265FC11D9BC8F534BB4F070493D30" }, { "b" : "7F445D70A000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "B5381A457906D279073822A5CEB24C4BFEF94DDB" }, { "b" : "7F445F153000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "5D7B6259552275A3C17BD4C3FD05F5A6BF40CAA5" }, { "b" : "7F445D4D7000", "path" : "/usr/lib/x86_64-linux-gnu/libidn.so.11", "elfType" : 3, "buildId" : "E09D3783AD1D0BBCD3204FA01E4EF6D756E18F57" }, { "b" : "7F445D2BB000", "path" : "/usr/lib/x86_64-linux-gnu/librtmp.so.1", "elfType" : 3, "buildId" : "8D1CC1204D6B6D33BD1D2C5A2A0516A2234322CF" }, { "b" : "7F445D071000", "path" : "/usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "DB5180B568097E2A4690A5B40D36BD134C893FEE" }, { "b" : "7F445CE62000", "path" : "/usr/lib/x86_64-linux-gnu/liblber-2.4.so.2", "elfType" : 3, "buildId" : "D3B183C41F02C7CD18F906AAFD19C69C850F1CEB" }, { "b" : "7F445CC11000", "path" : "/usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2", "elfType" : 3, "buildId" : "DA0EC53E16B3AC6BDC56EAEFE1BFECDDC395FB2E" }, { "b" : "7F445C9F7000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "8D9BD4CE26E45EF16075C67D5F5EEAFD8B562832" }, { "b" : "7F445C6C7000", "path" : "/usr/lib/x86_64-linux-gnu/libgnutls.so.30", "elfType" : 3, "buildId" : "3CE893F6D1382C2C7648DCCB06E71B1C7E0861CC" }, { "b" : "7F445C494000", "path" : "/usr/lib/x86_64-linux-gnu/libhogweed.so.4", "elfType" : 3, "buildId" : "B11678F560199547DCF726384EA39153EE0DFABF" }, { "b" : "7F445C25E000", "path" : "/usr/lib/x86_64-linux-gnu/libnettle.so.6", "elfType" : 3, "buildId" : "D6B36C5A463EE0FA84FDD6D5FD3F7726EDB90D54" }, { "b" : "7F445BFDE000", "path" : "/usr/lib/x86_64-linux-gnu/libgmp.so.10", "elfType" : 3, "buildId" : "7B3533D5998D20EE1A1BE3F87789B69041E7F620" }, { "b" : "7F445BD0C000", "path" : "/usr/lib/x86_64-linux-gnu/libkrb5.so.3", "elfType" : 3, "buildId" : "16E3DBC6D048145939BB43BBFD7954D27421B00F" }, { "b" : "7F445BADD000", "path" : "/usr/lib/x86_64-linux-gnu/libk5crypto.so.3", "elfType" : 3, "buildId" : "AEB4C08FC47F86C475E9D3996DFE5E9B403ACEBF" }, { "b" : "7F445B8D9000", "path" : "/lib/x86_64-linux-gnu/libcom_err.so.2", "elfType" : 3, "buildId" : "1E16CB57F699E215A2A8D4EFEF90883BC749B12D" }, { "b" : "7F445B6CE000", "path" : "/usr/lib/x86_64-linux-gnu/libkrb5support.so.0", "elfType" : 3, "buildId" : "DF3219B89E86920E901BAC4A80AA60F2B6134588" }, { "b" : "7F445B4B3000", "path" : "/usr/lib/x86_64-linux-gnu/libsasl2.so.2", "elfType" : 3, "buildId" : "96BCC7EB28D81B1469EED6F24FC083CBD58577BC" }, { "b" : "7F445B272000", "path" : "/usr/lib/x86_64-linux-gnu/libgssapi.so.3", "elfType" : 3, "buildId" : "1FE877BE52A424D0636AFD4D35BB330E41D6E0F3" }, { "b" : "7F445B00E000", "path" : "/usr/lib/x86_64-linux-gnu/libp11-kit.so.0", "elfType" : 3, "buildId" : "A0E2D03FF5CF65937F4425D4EFD4D655243809EB" }, { "b" : "7F445ADFB000", "path" : "/usr/lib/x86_64-linux-gnu/libtasn1.so.6", "elfType" : 3, "buildId" : "E07E186694852D8F69459C6AB28A53F8DA3CE3B6" }, { "b" : "7F445ABF7000", "path" : "/lib/x86_64-linux-gnu/libkeyutils.so.1", "elfType" : 3, "buildId" : "3364D4BF2113C4E8D17EF533867ECC99A53413D6" }, { "b" : "7F445A9EE000", "path" : "/usr/lib/x86_64-linux-gnu/libheimntlm.so.0", "elfType" : 3, "buildId" : "73A8EADBC85860662B24850E71D4AFBE22C33359" }, { "b" : "7F445A764000", "path" : "/usr/lib/x86_64-linux-gnu/libkrb5.so.26", "elfType" : 3, "buildId" : "59E742306A4EA2872E061ECCE92F35FADDA75357" }, { "b" : "7F445A4C2000", "path" : "/usr/lib/x86_64-linux-gnu/libasn1.so.8", "elfType" : 3, "buildId" : "E5C159E415406AE79D21056D752BA949C408B5B1" }, { "b" : "7F445A28F000", "path" : "/usr/lib/x86_64-linux-gnu/libhcrypto.so.4", "elfType" : 3, "buildId" : "7D15576E1F096614D360784E4A01A1F5FAF908C9" }, { "b" : "7F445A079000", "path" : "/usr/lib/x86_64-linux-gnu/libroken.so.18", "elfType" : 3, "buildId" : "481DB33C28D88E43DA6BED65E1A7599407D4D818" }, { "b" : "7F4459E71000", "path" : "/usr/lib/x86_64-linux-gnu/libffi.so.6", "elfType" : 3, "buildId" : "9D9C958F1F4894AFEF6AECD90D1C430EA29AC34F" }, { "b" : "7F4459C48000", "path" : "/usr/lib/x86_64-linux-gnu/libwind.so.0", "elfType" : 3, "buildId" : "57E25072866B2D30CF02EBE7AE623B84F96FA700" }, { "b" : "7F4459A39000", "path" : "/usr/lib/x86_64-linux-gnu/libheimbase.so.1", "elfType" : 3, "buildId" : "F6F1B4E9F89B716C4A0BA5819BDFFAF4A13EFB91" }, { "b" : "7F44597EE000", "path" : "/usr/lib/x86_64-linux-gnu/libhx509.so.5", "elfType" : 3, "buildId" : "C60082E3BB78D0D42868D9B359B89BF66CE5A1A7" }, { "b" : "7F4459519000", "path" : "/usr/lib/x86_64-linux-gnu/libsqlite3.so.0", "elfType" : 3, "buildId" : "D9782BA023CAEC26B15D8676E3A5D07B55E121EF" }, { "b" : "7F44592E1000", "path" : "/lib/x86_64-linux-gnu/libcrypt.so.1", "elfType" : 3, "buildId" : "7BDD51353D50310FFA1587E4AA01B40ABE32D582" } ] }} |
| Comment by y yz [ 02/Nov/23 ] |
|
|