2018-07-28T21:11:08.227+0430 I CONTROL [main] ***** SERVER RESTARTED ***** 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] MongoDB starting : pid=28464 port=27888 dbpath=/var/lib/mongodb 64-bit host=navak-app-srv 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] db version v3.2.9 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.2g 1 Mar 2016 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] allocator: tcmalloc 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] modules: none 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] build environment: 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] distmod: ubuntu1604 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] distarch: x86_64 2018-07-28T21:11:08.240+0430 I CONTROL [initandlisten] target_arch: x86_64 2018-07-28T21:11:08.241+0430 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "127.0.0.1", port: 27888 }, security: { authorization: "disabled" }, storage: { dbPath: "/var/lib/mongodb", journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod.log", quiet: true } } 2018-07-28T21:11:08.303+0430 I - [initandlisten] Detected data files in /var/lib/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2018-07-28T21:11:08.303+0430 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/mongod.lock is not empty. 2018-07-28T21:11:08.303+0430 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2018-07-28T21:11:08.303+0430 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=11G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2018-07-28T21:11:08.828+0430 E STORAGE [initandlisten] WiredTiger (0) [1532796068:828621][28464:0x7f5aea7dac80], file:collection-19715-2421989049427328817.wt, txn-recover: read checksum error for 20480B block at offset 182607872: block header checksum of 2696748540 doesn't match expected checksum of 3770502280 2018-07-28T21:11:08.828+0430 E STORAGE [initandlisten] WiredTiger (0) [1532796068:828718][28464:0x7f5aea7dac80], file:collection-19715-2421989049427328817.wt, txn-recover: collection-19715-2421989049427328817.wt: encountered an illegal file format or internal value 2018-07-28T21:11:08.828+0430 E STORAGE [initandlisten] WiredTiger (-31804) [1532796068:828746][28464:0x7f5aea7dac80], file:collection-19715-2421989049427328817.wt, txn-recover: the process must exit and restart: WT_PANIC: WiredTiger library panic 2018-07-28T21:11:08.828+0430 I - [initandlisten] Fatal Assertion 28558 2018-07-28T21:11:08.828+0430 I - [initandlisten] ***aborting after fassert() failure 2018-07-28T21:11:08.852+0430 F - [initandlisten] Got signal: 6 (Aborted). 0x1521902 0x15208a9 0x1521112 0x7f5ae93e5390 0x7f5ae903f428 0x7f5ae904102a 0x14a3713 0x12480f2 0x1c371b7 0x1c375ae 0x1c379b4 0x1b6421f 0x1b6474b 0x1b613e8 0x1b65827 0x1b83008 0x1bb77d0 0x1c35fcb 0x1c36560 0x1c366dc 0x1bc6bb8 0x1c33208 0x1c45f18 0x1c462bb 0x1be8362 0x1c46ead 0x1bbb5b7 0x1bb3f43 0x122cdb8 0x1225f85 0x1121898 0x9c0070 0x975802 0x7f5ae902a830 0x9ba699 ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"1121902","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"11208A9"},{"b":"400000","o":"1121112"},{"b":"7F5AE93D4000","o":"11390"},{"b":"7F5AE900A000","o":"35428","s":"gsignal"},{"b":"7F5AE900A000","o":"3702A","s":"abort"},{"b":"400000","o":"10A3713","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"E480F2"},{"b":"400000","o":"18371B7","s":"__wt_eventv"},{"b":"400000","o":"18375AE","s":"__wt_err"},{"b":"400000","o":"18379B4","s":"__wt_panic"},{"b":"400000","o":"176421F","s":"__wt_block_extlist_read"},{"b":"400000","o":"176474B","s":"__wt_block_extlist_read_avail"},{"b":"400000","o":"17613E8","s":"__wt_block_checkpoint_load"},{"b":"400000","o":"1765827"},{"b":"400000","o":"1783008","s":"__wt_btree_open"},{"b":"400000","o":"17B77D0","s":"__wt_conn_btree_open"},{"b":"400000","o":"1835FCB","s":"__wt_session_get_btree"},{"b":"400000","o":"1836560","s":"__wt_session_get_btree"},{"b":"400000","o":"18366DC","s":"__wt_session_get_btree_ckpt"},{"b":"400000","o":"17C6BB8","s":"__wt_curfile_open"},{"b":"400000","o":"1833208"},{"b":"400000","o":"1845F18"},{"b":"400000","o":"18462BB"},{"b":"400000","o":"17E8362","s":"__wt_log_scan"},{"b":"400000","o":"1846EAD","s":"__wt_txn_recover"},{"b":"400000","o":"17BB5B7","s":"__wt_connection_workers"},{"b":"400000","o":"17B3F43","s":"wiredtiger_open"},{"b":"400000","o":"E2CDB8","s":"_ZN5mongo18WiredTigerKVEngineC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_S8_mbbb"},{"b":"400000","o":"E25F85"},{"b":"400000","o":"D21898","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"400000","o":"5C0070","s":"_ZN5mongo13initAndListenEi"},{"b":"400000","o":"575802","s":"main"},{"b":"7F5AE900A000","o":"20830","s":"__libc_start_main"},{"b":"400000","o":"5BA699","s":"_start"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.4.0-116-generic", "version" : "#140-Ubuntu SMP Mon Feb 12 21:23:04 UTC 2018", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "1F47133C759EFF79F90A6EBF640DC97B744D70C1" }, { "b" : "7FFC462F0000", "elfType" : 3, "buildId" : "2743AEADCDA27954EA08FA4C94C6DB97E2A37F92" }, { "b" : "7F5AEA360000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "DCF10134B91ED2139E3E8C72564668F5CDBA8522" }, { "b" : "7F5AE9F1C000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "1649272BE0CA9FA22F082DC86372B6C9959779B0" }, { "b" : "7F5AE9D14000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "89C34D7A182387D76D5CDA1F7718F5D58824DFB3" }, { "b" : "7F5AE9B10000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "8CC8D0D119B142D839800BFF71FB71E73AEA7BD4" }, { "b" : "7F5AE9807000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "DFB85DE42DAFFD09640C8FE377D572DE3E168920" }, { "b" : "7F5AE95F1000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "68220AE2C65D65C1B6AAA12FA6765A6EC2F5F434" }, { "b" : "7F5AE93D4000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "CE17E023542265FC11D9BC8F534BB4F070493D30" }, { "b" : "7F5AE900A000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "B5381A457906D279073822A5CEB24C4BFEF94DDB" }, { "b" : "7F5AEA5C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "5D7B6259552275A3C17BD4C3FD05F5A6BF40CAA5" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x1521902] mongod(+0x11208A9) [0x15208a9] mongod(+0x1121112) [0x1521112] libpthread.so.0(+0x11390) [0x7f5ae93e5390] libc.so.6(gsignal+0x38) [0x7f5ae903f428] libc.so.6(abort+0x16A) [0x7f5ae904102a] mongod(_ZN5mongo13fassertFailedEi+0x93) [0x14a3713] mongod(+0xE480F2) [0x12480f2] mongod(__wt_eventv+0x4F7) [0x1c371b7] mongod(__wt_err+0x8E) [0x1c375ae] mongod(__wt_panic+0x24) [0x1c379b4] mongod(__wt_block_extlist_read+0x6F) [0x1b6421f] mongod(__wt_block_extlist_read_avail+0x2B) [0x1b6474b] mongod(__wt_block_checkpoint_load+0x1F8) [0x1b613e8] mongod(+0x1765827) [0x1b65827] mongod(__wt_btree_open+0xBA8) [0x1b83008] mongod(__wt_conn_btree_open+0x140) [0x1bb77d0] mongod(__wt_session_get_btree+0xEB) [0x1c35fcb] mongod(__wt_session_get_btree+0x680) [0x1c36560] mongod(__wt_session_get_btree_ckpt+0x12C) [0x1c366dc] mongod(__wt_curfile_open+0x218) [0x1bc6bb8] mongod(+0x1833208) [0x1c33208] mongod(+0x1845F18) [0x1c45f18] mongod(+0x18462BB) [0x1c462bb] mongod(__wt_log_scan+0xB22) [0x1be8362] mongod(__wt_txn_recover+0x50D) [0x1c46ead] mongod(__wt_connection_workers+0x37) [0x1bbb5b7] mongod(wiredtiger_open+0x15A3) [0x1bb3f43] mongod(_ZN5mongo18WiredTigerKVEngineC1ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_S8_mbbb+0xDD8) [0x122cdb8] mongod(+0xE25F85) [0x1225f85] mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x3E8) [0x1121898] mongod(_ZN5mongo13initAndListenEi+0x480) [0x9c0070] mongod(main+0x712) [0x975802] libc.so.6(__libc_start_main+0xF0) [0x7f5ae902a830] mongod(_start+0x29) [0x9ba699] ----- END BACKTRACE -----