[SERVER-62792] Mongo db suddnly stopped Created: 20/Jan/22  Updated: 27/Oct/23  Resolved: 23/Jan/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: ahmed atef Assignee: Unassigned
Resolution: Community Answered Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Operating System: ALL
Participants:

 Description   

Mongo DB is stopped due to the below error (V  db version v3.4.22)

ned:0 docsExamined:230303 numYields:1799 reslen:44 locks:{ Global:

{ acquireCoun t: \{ r: 3600 }

}, Database: { acquireCount:

{ r: 1800 }

}, Collection:

{ acquire Count: \{ r: 1800 }

} } protocol:op_query 181ms
2022-01-20T09:08:16.961+0000 E STORAGE [thread2] WiredTiger error (1) [16426696
96:961185][9067:0x7fc3e689b700], file:WiredTiger.wt, WT_SESSION.checkpoint: /dat
a/db/WiredTiger.turtle: handle-open: open: Operation not permitted
2022-01-20T09:08:16.961+0000 E STORAGE [thread2] WiredTiger error (1) [16426696
96:961779][9067:0x7fc3e689b700], checkpoint-server: checkpoint server error: Ope
ration not permitted
2022-01-20T09:08:16.962+0000 E STORAGE [thread2] WiredTiger error (-31804) [164
2669696:961815][9067:0x7fc3e689b700], checkpoint-server: the process must exit a
nd restart: WT_PANIC: WiredTiger library panic
2022-01-20T09:08:16.964+0000 I - [thread2] Fatal Assertion 28558 at src/m
ongo/db/storage/wiredtiger/wiredtiger_util.cpp 365
2022-01-20T09:08:16.964+0000 I - [thread2]

***aborting after fassert() failure

2022-01-20T09:08:16.997+0000 F - [thread2] Got signal: 6 (Aborted).

0x55817b338d41 0x55817b337f59 0x55817b33843d 0x7fc3ebca9890 0x7fc3eb8e4e97 0x7f
c3eb8e6801 0x55817a5c94e7 0x55817b03d266 0x55817a5d3b64 0x55817a5d3d89 0x55817a5
d3feb 0x55817bc99083 0x7fc3ebc9e6db 0x7fc3eb9c788f
----- BEGIN BACKTRACE -----
{"backtrace":[

{"b":"558179D86000","o":"15B2D41","s":"_ZN5mongo15printStackTraceE RSo"}

,{"b":"558179D86000","o":"15B1F59"},{"b":"558179D86000","o":"15B243D"},

{"b" :"7FC3EBC97000","o":"12890"}

,{"b":"7FC3EB8A6000","o":"3EE97","s":"gsignal"},

{"b" :"7FC3EB8A6000","o":"40801","s":"abort"}

,

{"b":"558179D86000","o":"8434E7","s":"_ ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj"}

,

{"b":"558179D86000","o":"12B7 266"}

,{"b":"558179D86000","o":"84DB64","s":"__wt_eventv"},

{"b":"558179D86000","o ":"84DD89","s":"__wt_err"}

,{"b":"558179D86000","o":"84DFEB","s":"__wt_panic"},

{" b":"558179D86000","o":"1F13083"}

,{"b":"7FC3EBC97000","o":"76DB"},

{"b":"7FC3EB8A6 000","o":"12188F","s":"clone"}

],"processInfo":{ "mongodbVersion" : "3.4.22", "gi
tVersion" : "aa313e18da568c4afd120f99e56d2da7d7fcdd58", "compiledModules" : [],
"uname" :

{ "sysname" : "Linux", "release" : "5.0.0-1016-azure", "version" : "#1 7~18.04.1-Ubuntu SMP Thu Aug 15 15:58:09 UTC 2019", "machine" : "x86_64" }

, "som
ap" : [

{ "b" : "558179D86000", "elfType" : 3, "buildId" : "847B3AF37716C2247DA2 89A43D9854E98053D28B" }

,

{ "b" : "7FFE08F01000", "path" : "linux-vdso.so.1", "el fType" : 3, "buildId" : "0CB39F0E4C242F82DC9F23AC25A7BCECFEC19D53" }

,

{ "b" : "7 FC3ECCBB000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "0D054641049B9747C05D030262295DFDFDD3055D" }

,

{ "b" : "7FC3EC8780 00", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "bu ildId" : "9C228817BA6E0730F4FCCFAC6E033BD1E0C5620A" }

,

{ "b" : "7FC3EC670000", " path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "9826FBDF 57ED7D6965131074CB3C08B1009C1CD8" }

,

{ "b" : "7FC3EC46C000", "path" : "/lib/x86_ 64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "25AD56E902E23B490A9CCDB08A 9744D89CB95BCC" }

,

{ "b" : "7FC3EC0CE000", "path" : "/lib/x86_64-linux-gnu/libm. so.6", "elfType" : 3, "buildId" : "A33761AB8FB485311B3C85BF4253099D7CABE653" }

,

{ "b" : "7FC3EBEB6000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType " : 3, "buildId" : "41BDC55C07D5E5B1D8AB38E2C19B1F535855E084" }

,

{ "b" : "7FC3EB C97000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "build Id" : "28C6AADE70B2D40D1F0F3D0A1A0CAD1AB816448F" }

,

{ "b" : "7FC3EB8A6000", "pat h" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "B417C0BA7CC5 CF06D1D1BED6652CEDB9253C60D0" }

,

{ "b" : "7FC3ECF23000", "path" : "/lib64/ld-lin ux-x86-64.so.2", "elfType" : 3, "buildId" : "64DF1B961228382FE18684249ED800AB1DC EAAD4" }

] }}
mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x55817b338d41]
mongod(+0x15B1F59) [0x55817b337f59]
mongod(+0x15B243D) [0x55817b33843d]
libpthread.so.0(+0x12890) [0x7fc3ebca9890]
libc.so.6(gsignal+0xC7) [0x7fc3eb8e4e97]
libc.so.6(abort+0x141) [0x7fc3eb8e6801]
mongod(_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj+0x0) [0x55817a5c94e7]
mongod(+0x12B7266) [0x55817b03d266]
mongod(__wt_eventv+0x3D7) [0x55817a5d3b64]
mongod(__wt_err+0x9D) [0x55817a5d3d89]
mongod(__wt_panic+0x2E) [0x55817a5d3feb]
mongod(+0x1F13083) [0x55817bc99083]
libpthread.so.0(+0x76DB) [0x7fc3ebc9e6db]
libc.so.6(clone+0x3F) [0x7fc3eb9c788f]



 Comments   
Comment by Dmitry Agranat [ 23/Jan/22 ]

ahmad_atef@siliconexpert.com, MongoDB 3.4 has reached EOL in January 2020 and the SERVER project is for reporting bugs in the supported MongoDB server. We'd like to encourage you to start by asking our community for help by posting on the MongoDB Developer Community Forums.

That looks like a permissions issue. Please make sure that all the WiredTiger.* files in the database directory have the same owner, group, and permissions. In other words, they look the same in ls -l apart from file size and date.

Regards,
Dima

Generated at Thu Feb 08 05:56:04 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.