2018-07-28T12:27:40.744+0700 I CONTROL [initandlisten] distmod: rhel70 2018-07-28T12:27:40.744+0700 I CONTROL [initandlisten] distarch: x86_64 2018-07-28T12:27:40.744+0700 I CONTROL [initandlisten] target_arch: x86_64 2018-07-28T12:27:40.744+0700 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "127.0.0.1,10.116.109.162", port: 27017 }, processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid", timeZoneInfo: "/usr/share/zoneinfo" }, replication: { replSetName: "simplepayment" }, storage: { dbPath: "/data/mongo", journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod.log" } } 2018-07-28T12:27:40.797+0700 W - [initandlisten] Detected unclean shutdown - /data/mongo/mongod.lock is not empty. 2018-07-28T12:27:40.817+0700 I - [initandlisten] Detected data files in /data/mongo created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2018-07-28T12:27:40.817+0700 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2018-07-28T12:27:40.817+0700 I STORAGE [initandlisten] 2018-07-28T12:27:40.817+0700 I STORAGE [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine 2018-07-28T12:27:40.817+0700 I STORAGE [initandlisten] ** See http://dochub.mongodb.org/core/prodnotes-filesystem 2018-07-28T12:27:40.817+0700 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=3396M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress), 2018-07-28T12:27:40.941+0700 E STORAGE [initandlisten] WiredTiger error (0) [1532755660:941845][1588:0x7f75eee06b00], file:WiredTiger.wt, connection: read checksum error for 4096B block at offset 24576: block header checksum of 3976941490 doesn't match expected checksum of 2046724027 2018-07-28T12:27:40.941+0700 E STORAGE [initandlisten] WiredTiger error (0) [1532755660:941909][1588:0x7f75eee06b00], file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value: (__wt_block_read_off, 227) 2018-07-28T12:27:40.941+0700 E STORAGE [initandlisten] WiredTiger error (-31804) [1532755660:941966][1588:0x7f75eee06b00], file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic 2018-07-28T12:27:40.941+0700 F - [initandlisten] Fatal Assertion 28558 at src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp 361 2018-07-28T12:27:40.942+0700 F - [initandlisten] ***aborting after fassert() failure 2018-07-28T12:27:41.096+0700 F - [initandlisten] Got signal: 6 (Aborted). 0x5637cdf79061 0x5637cdf78279 0x5637cdf7875d 0x7f75ed7d85e0 0x7f75ed43b1f7 0x7f75ed43c8e8 0x5637cc706517 0x5637cc7d2d4e 0x5637cc6a35b7 0x5637cc6a37d3 0x5637cc6a3afc 0x5637cc8e7daf 0x5637cc8e82fb 0x5637cc 8e48b5 0x5637cc8ce857 0x5637cc8511e7 0x5637cc7e2b76 0x5637cc82f59b 0x5637cc82fabd 0x5637cc82fd7c 0x5637cc8983e2 0x5637cc826328 0x5637cc7fc41e 0x5637cc7fc4fb 0x5637cc7e16f4 0x5637cc7b70a9 0x5637cc79b6a4 0x 5637cc96bfd7 0x5637cc69f367 0x5637cc77a44c 0x5637cc7081d9 0x7f75ed427c05 0x5637cc769def ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"5637CBD7C000","o":"21FD061","s":"_ZN5mongo15printStackTraceERSo"},{"b":"5637CBD7C000","o":"21FC279"},{"b":"5637CBD7C000","o":"21FC75D"},{"b":"7F75ED7C9000","o":"F5E0"},{"b":"7F75ED4060 00","o":"351F7","s":"gsignal"},{"b":"7F75ED406000","o":"368E8","s":"abort"},{"b":"5637CBD7C000","o":"98A517","s":"_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj"},{"b":"5637CBD7C000","o":"A56D4E"},{"b" :"5637CBD7C000","o":"9275B7","s":"__wt_eventv"},{"b":"5637CBD7C000","o":"9277D3","s":"__wt_err"},{"b":"5637CBD7C000","o":"927AFC","s":"__wt_panic"},{"b":"5637CBD7C000","o":"B6BDAF","s":"__wt_block_extlist _read"},{"b":"5637CBD7C000","o":"B6C2FB","s":"__wt_block_extlist_read_avail"},{"b":"5637CBD7C000","o":"B688B5","s":"__wt_block_checkpoint_load"},{"b":"5637CBD7C000","o":"B52857"},{"b":"5637CBD7C000","o":" AD51E7","s":"__wt_btree_open"},{"b":"5637CBD7C000","o":"A66B76","s":"__wt_conn_dhandle_open"},{"b":"5637CBD7C000","o":"AB359B","s":"__wt_session_get_dhandle"},{"b":"5637CBD7C000","o":"AB3ABD","s":"__wt_se ssion_get_dhandle"},{"b":"5637CBD7C000","o":"AB3D7C","s":"__wt_session_get_btree_ckpt"},{"b":"5637CBD7C000","o":"B1C3E2","s":"__wt_curfile_open"},{"b":"5637CBD7C000","o":"AAA328"},{"b":"5637CBD7C000","o": "A8041E","s":"__wt_metadata_cursor_open"},{"b":"5637CBD7C000","o":"A804FB","s":"__wt_metadata_cursor"},{"b":"5637CBD7C000","o":"A656F4","s":"wiredtiger_open"},{"b":"5637CBD7C000","o":"A3B0A9","s":"_ZN5mon go18WiredTigerKVEngineC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb"},{"b":"5637CBD7C000","o":"A1F6A4"},{"b":"5637CBD7C000","o":"BEFFD7","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"5637CBD7C000","o":"923367"},{"b":"5637CBD7C000","o":"9FE44C","s":"_ZN5mongo11mongoDbMainEiPPcS1_"},{"b":"5637CBD7C000","o":"98C1D9","s":"main"},{"b":"7F75ED406000","o":"21C05","s":"__libc_start_main"},{"b":"5637CBD7C000","o":"9EDDEF"}],"processInfo":{ "mongodbVersion" : "3.6.2", "gitVersion" : "489d177dbd0f0420a8ca04d39fd78d0a2c539420", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.0-693.11.6.el7.x86_64", "version" : "#1 SMP Thu Jan 4 01:06:37 UTC 2018", "machine" : "x86_64" }, "somap" : [ { "b" : "5637CBD7C000", "elfType" : 3, "buildId" : "D02F86992A859CC55616E5547729F7F8C6D7F890" }, { "b" : "7FFEDE418000", "elfType" : 3, "buildId" : "33DEC63F3B0D3EE9ABDAC478FF3E7F1F43FAF9DE" }, { "b" : "7F75EE9DC000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "FF4E72F4E574E143330FB3C66DB51613B0EC65EA" }, { "b" : "7F75EE76A000", "path" : "/lib64/libssl.so.10", "elfType" : 3, "buildId" : "ED0AC7DEB91A242C194B3DEF27A215F41CE43116" }, { "b" : "7F75EE309000", "path" : "/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "BC0AE9CA0705BEC1F0C0375AAD839843BB219CB1" }, { "b" : "7F75EE101000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "6D322588B36D2617C03C0F3B93677E62FCFFDA81" }, { "b" : "7F75EDEFD000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "1E42EBFB272D37B726F457D6FE3C33D2B094BB69" }, { "b" : "7F75EDBFB000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "808BD35686C193F218A5AAAC6194C49214CFF379" }, { "b" : "7F75ED9E5000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "3E85E6D20D2CE9CDAD535084BEA56620BAAD687C" }, { "b" : "7F75ED7C9000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "A48D21B2578A8381FBD8857802EAA660504248DC" }, { "b" : "7F75ED406000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "95FF02A4BEBABC573C7827A66D447F7BABDDAA44" }, { "b" : "7F75EEBF6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "22FA66DA7D14C88BF36C69454A357E5F1DEFAE4E" }, { "b" : "7F75ED1B9000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "DA322D74F55A0C4293085371A8D0E94B5962F5E7" }, { "b" : "7F75ECED1000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "B69E63024D408E400401EEA6815317BDA38FB7C2" }, { "b" : "7F75ECCCD000", "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "A3832734347DCA522438308C9F08F45524C65C9B" }, { "b" : "7F75ECA9A000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "A48639BF901DB554479BFAD114CB354CF63D7D6E" }, { "b" : "7F75EC884000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "EA8E45DC8E395CC5E26890470112D97A1F1E0B65" }, { "b" : "7F75EC676000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "6FDF5B013FD2739D304CFB9D723DCBC149EE03C9" }, { "b" : "7F75EC472000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "2E01D5AC08C1280D013AAB96B292AC58BC30A263" }, { "b" : "7F75EC24B000", "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "A88379F56A51950A33198890D37F5F8AEE71F8B4" }, { "b" : "7F75EBFE9000", "path" : "/lib64/libpcre.so.1", "elfType" : 3, "buildId" : "9CA3D11F018BEEB719CDB34BE800BF1641350D0A" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x5637cdf79061] mongod(+0x21FC279) [0x5637cdf78279] mongod(+0x21FC75D) [0x5637cdf7875d] libpthread.so.0(+0xF5E0) [0x7f75ed7d85e0] libc.so.6(gsignal+0x37) [0x7f75ed43b1f7] libc.so.6(abort+0x148) [0x7f75ed43c8e8] mongod(_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj+0x0) [0x5637cc706517] mongod(+0xA56D4E) [0x5637cc7d2d4e] mongod(__wt_eventv+0x3D7) [0x5637cc6a35b7] mongod(__wt_err+0x9D) [0x5637cc6a37d3] mongod(__wt_panic+0x33) [0x5637cc6a3afc] mongod(__wt_block_extlist_read+0x8F) [0x5637cc8e7daf] mongod(__wt_block_extlist_read_avail+0x2B) [0x5637cc8e82fb] mongod(__wt_block_checkpoint_load+0x275) [0x5637cc8e48b5] mongod(+0xB52857) [0x5637cc8ce857] mongod(__wt_btree_open+0xBE7) [0x5637cc8511e7] mongod(__wt_conn_dhandle_open+0x276) [0x5637cc7e2b76] mongod(__wt_session_get_dhandle+0xFB) [0x5637cc82f59b] mongod(__wt_session_get_dhandle+0x61D) [0x5637cc82fabd] mongod(__wt_session_get_btree_ckpt+0x14C) [0x5637cc82fd7c] mongod(__wt_curfile_open+0x52) [0x5637cc8983e2] mongod(+0xAAA328) [0x5637cc826328] mongod(__wt_metadata_cursor_open+0x6E) [0x5637cc7fc41e] mongod(__wt_metadata_cursor+0x4B) [0x5637cc7fc4fb] mongod(wiredtiger_open+0x19D4) [0x5637cc7e16f4] mongod(_ZN5mongo18WiredTigerKVEngineC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb+0x889) [0x5637cc7b70a9] mongod(+0xA1F6A4) [0x5637cc79b6a4] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x637) [0x5637cc96bfd7] mongod(+0x923367) [0x5637cc69f367] mongod(_ZN5mongo11mongoDbMainEiPPcS1_+0x86C) [0x5637cc77a44c] mongod(main+0x9) [0x5637cc7081d9] libc.so.6(__libc_start_main+0xF5) [0x7f75ed427c05] mongod(+0x9EDDEF) [0x5637cc769def] ----- END BACKTRACE -----