[SERVER-12722] mongod crash: mongod(_ZN5mongo3dur16REMAPPRIVATEVIEWEv+0x20) [0x91c870] Created: 14/Feb/14  Updated: 18/Mar/14  Resolved: 18/Mar/14

Status: Closed
Project: Core Server
Component/s: Storage
Affects Version/s: 2.4.5
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: wanglei Assignee: Unassigned
Resolution: Incomplete Votes: 0
Labels: crash
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

CentOS release 5.6 (Final)

2.6.18-238.el5 #1 SMP Thu Jan 13 15:51:15 EST 2011 x86_64 x86_64 x86_64 GNU/Linux


Operating System: Linux
Steps To Reproduce:

unknown

Participants:

 Description   

...
Fri Feb 14 17:08:23.988 [conn139998333] end connection 192.168.11.39:64335 (10522 connections now open)
Fri Feb 14 17:08:23.988 [conn139998711] end connection 192.168.xx.xx:3238 (10521 connections now open)
Fri Feb 14 17:08:23.989 [conn139998513] end connection 192.168.11.39:64818 (10520 connections now open)
Fri Feb 14 17:08:23.989 [conn140001005] end connection 192.168.xx.xx:9002 (10519 connections now open)
Fri Feb 14 17:08:23.996 [initandlisten] connection accepted from 192.168.11.22:42683 #140008097 (10520 connections now open)
Fri Feb 14 17:08:23.997 [initandlisten] connection accepted from 192.168.11.20:31992 #140008098 (10521 connections now open)
Fri Feb 14 17:08:24.000 [conn140008097] authenticate db: d_6706

{ authenticate: 1, user: "xxxx", nonce: "xxxx", key: "xxxxxxx" }

Fri Feb 14 17:08:24.000 [conn140008098] authenticate db: d_21998

{ authenticate: 1, user: "xxxxx", nonce: "xxxxx", key: "xxxxxx" }

Fri Feb 14 17:08:24.006 Backtrace:
0xdd9e31 0x6d0d09 0x31a0c302d0 0x31a0c30265 0x31a0c31d10 0xdbc85c 0xa5557a 0x91c585 0x91c870 0x91e803 0x91ec6c 0x91f0ab 0xe225d9 0x31a180673d 0x31a0cd40cd
/usr/local/mongodb-2.4.5/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
/usr/local/mongodb-2.4.5/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x6d0d09]
/lib64/libc.so.6 [0x31a0c302d0]
/lib64/libc.so.6(gsignal+0x35) [0x31a0c30265]
/lib64/libc.so.6(abort+0x110) [0x31a0c31d10]
/usr/local/mongodb-2.4.5/bin/mongod(_ZN5mongo16MemoryMappedFile16remapPrivateViewEPv+0xfc) [0xdbc85c]
/usr/local/mongodb-2.4.5/bin/mongod(_ZN5mongo8MongoMMF19remapThePrivateViewEv+0x2a) [0xa5557a]
/usr/local/mongodb-2.4.5/bin/mongod [0x91c585]
/usr/local/mongodb-2.4.5/bin/mongod(_ZN5mongo3dur16REMAPPRIVATEVIEWEv+0x20) [0x91c870]
/usr/local/mongodb-2.4.5/bin/mongod [0x91e803]
/usr/local/mongodb-2.4.5/bin/mongod [0x91ec6c]
/usr/local/mongodb-2.4.5/bin/mongod(_ZN5mongo3dur9durThreadEv+0x2fb) [0x91f0ab]
/usr/local/mongodb-2.4.5/bin/mongod [0xe225d9]
/lib64/libpthread.so.0 [0x31a180673d]
/lib64/libc.so.6(clone+0x6d) [0x31a0cd40cd]

          • SERVER RESTARTED *****


 Comments   
Comment by Stennie Steneker (Inactive) [ 18/Mar/14 ]

Hi,

Given we don't have any further information to be able to reproduce or investigate this issue, I'm going to close it.

Please feel free to reopen if you have additional information.

Thanks,
Stephen

Comment by Daniel Pasette (Inactive) [ 18/Feb/14 ]

Thanks for the report. Have you had any further incidents of this type? Do you have the syslog for this time period?

According to addr2line this is hitting a verify in the journaling thread:
https://github.com/mongodb/mongo/blob/r2.4.5/src/mongo/util/mmap_posix.cpp#L186

$ addr2line -p -C -f -i -e ~/dist/2.4.5-debug/bin/mongod 0xdd9e31 0x6d0d09 0x31a0c302d0 0x31a0c30265 0x31a0c31d10 0xdbc85c 0xa5557a 0x91c585 0x91c870 0x91e803 0x91ec6c 0x91f0ab 0xe225d9 0x31a180673d 0x31a0cd40cd
 
mongo::printStackTrace(std::ostream&) at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/util/stacktrace.cpp:40
std::basic_streambuf<char, std::char_traits<char> >::pptr() const at /usr/lib/gcc/x86_64-redhat-linux/4.1.2/../../../../include/c++/4.1.2/streambuf:515
 (inlined by) std::basic_stringbuf<char, std::char_traits<char>, std::allocator<char> >::str() const at /usr/lib/gcc/x86_64-redhat-linux/4.1.2/../../../../include/c++/4.1.2/sstream:131
 (inlined by) std::basic_ostringstream<char, std::char_traits<char>, std::allocator<char> >::str() const at /usr/lib/gcc/x86_64-redhat-linux/4.1.2/../../../../include/c++/4.1.2/sstream:463
 (inlined by) mongo::abruptQuit(int) at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/db/db.cpp:1331
??
??:0
??
??:0
??
??:0
mongo::MemoryMappedFile::remapPrivateView(void*) at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/util/mmap_posix.cpp:186
fassert at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/util/assert_util.h:197
 (inlined by) mongo::MongoMMF::remapThePrivateView() at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/db/mongommf.cpp:46
std::_Rb_tree_const_iterator<mongo::MongoFile*>::operator++(int) at /usr/lib/gcc/x86_64-redhat-linux/4.1.2/../../../../include/c++/4.1.2/bits/stl_tree.h:265
 (inlined by) _REMAPPRIVATEVIEW at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/db/dur.cpp:523
mongo::dur::REMAPPRIVATEVIEW() at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/db/dur.cpp:536
groupCommit at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/db/dur.cpp:727
durThreadGroupCommit at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/db/dur.cpp:749
mongo::dur::durThread() at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/mongo/db/dur.cpp:784
thread_proxy at /mntfast/data/slave/Linux_64bit_V2.4/mongo/src/third_party/boost/libs/thread/src/pthread/thread.cpp:133
??
??:0
??
??:0

Generated at Thu Feb 08 03:29:25 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.